Jun 12 04:34:39 devstack cinder-volume[81638]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:34:39 devstack cinder-volume[81638]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:34:39 devstack cinder-volume[81638]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:34:40 devstack cinder-volume[81638]: INFO dbcounter [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Registered counter for database cinder Jun 12 04:34:40 devstack cinder-volume[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:34:40 devstack cinder-volume[81638]: DEBUG dbcounter [-] [81638] Writer thread running {{(pid=81638) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 12 04:34:40 devstack cinder-volume[81638]: INFO cinder.rpc [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 12 04:34:40 devstack cinder-volume[81638]: INFO cinder.rpc [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 12 04:34:40 devstack cinder-volume[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:34:40 devstack cinder-volume[81638]: INFO cinder.volume.manager [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Determined volume DB was empty at startup. Jun 12 04:34:40 devstack cinder-volume[81638]: DEBUG cinder.volume.manager [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81638) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 12 04:34:40 devstack cinder-volume[81638]: INFO cinder.volume.manager [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 12 04:34:40 devstack cinder-volume[81638]: WARNING stevedore.named [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 12 04:34:40 devstack cinder-volume[81638]: WARNING castellan.key_manager [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:34:40 devstack cinder-volume[81638]: WARNING cinder.keymgr.conf_key_mgr [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:34:40 devstack cinder-volume[81638]: DEBUG cinder.volume.drivers.lvm [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81638) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 12 04:34:40 devstack cinder-volume[81638]: DEBUG oslo_concurrency.processutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81638) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_concurrency.processutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] CMD "cinder-rtstool verify" returned: 0 in 0.360s {{(pid=81638) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:34:41 devstack cinder-volume[81638]: INFO cinder.rpc [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 12 04:34:41 devstack cinder-volume[81638]: INFO cinder.rpc [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 12 04:34:41 devstack cinder-volume[81638]: WARNING stevedore.named [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 12 04:34:41 devstack cinder-volume[81638]: WARNING castellan.key_manager [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:34:41 devstack cinder-volume[81638]: INFO cinder.volume.manager [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:34:41 devstack cinder-volume[81638]: INFO oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Starting 1 workers Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Started child 81808 {{(pid=81638) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Full set of CONF: {{(pid=81638) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] ******************************************************************************** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Configuration options gathered from: {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] ================================================================================ {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] allow_availability_zone_fallback = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] allow_compression_on_image_upload = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] allowed_direct_url_schemes = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] api_rate_limit = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] auth_strategy = keystone {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] az_cache_duration = 3600 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_availability_zone = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_host = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_stats_polling_interval = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backup_api_class = cinder.backup.api.API {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backup_name_template = backup-%s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backup_use_same_host = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backup_use_temp_snapshot = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] chap_password = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] chap_username = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_internal_tenant_project_id = 5056e03a4ed040509c808b8f1b00c56a {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81808]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_internal_tenant_user_id = 7bfd0da3b97e4cafa475e4212c04d57c {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cloned_volume_same_az = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cluster = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] compression_format = gzip {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] compute_api_class = cinder.compute.nova.API {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] config_dir = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] config_source = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] control_exchange = openstack {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] debug = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] default_availability_zone = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] default_group_type = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] default_volume_type = lvmdriver-1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] disk_geometry = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] driver_client_cert = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] driver_client_cert_key = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] driver_data_namespace = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] driver_ssl_cert_path = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] driver_ssl_cert_verify = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] driver_use_ssl = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] enable_force_upload = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] enable_new_services = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] enable_unsupported_driver = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] enabled_backends = ['lvmdriver-1'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] enforce_multipath_for_image_xfer = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] filter_function = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_api_insecure = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_api_ssl_compression = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_ca_certificates_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_catalog_info = image:glance:publicURL {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_num_retries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance_request_timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] goodness_function = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] graceful_shutdown_timeout = 5 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] group_api_class = cinder.group.api.API {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] host = devstack {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_compress_on_upload = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_conversion_address_space_limit = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_conversion_cpu_limit = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_conversion_disable = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_upload_use_cinder_backend = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_upload_use_internal_tenant = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_volume_cache_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_volume_cache_max_count = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] image_volume_cache_max_size_gb = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] init_host_max_objects_retrieval = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] instance_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] iscsi_target_flags = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] iscsi_write_cache = on {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack sudo[81816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] iser_helper = tgtadm {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] iser_ip_address = 192.168.122.136 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] iser_port = 3260 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_color = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_config_append = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack sudo[81816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_dir = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_options = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_rotate_interval = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_rotate_interval_type = days {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] log_rotation_type = none {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] max_age = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] max_logfile_count = 30 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] max_logfile_size_mb = 200 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] max_over_subscription_ratio = 20.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] message_reap_interval = 86400 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] message_ttl = 2592000 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] migration_create_volume_timeout_secs = 300 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] monkey_patch = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] monkey_patch_modules = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] my_ip = 192.168.122.136 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] no_snapshot_gb_quota = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] num_iser_scan_tries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] num_shell_tries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] num_volume_device_scan_tries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] nvmeof_conn_info_version = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] nvmet_ns_id = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] nvmet_port_id = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_max_limit = 1000 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_volume_ext_list = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_volume_listen_port = 8776 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_volume_use_ssl = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] osapi_volume_workers = 2 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] per_volume_size_limit = -1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] periodic_fuzzy_delay = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] periodic_interval = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] public_endpoint = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] publish_errors = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_backup_gigabytes = 1000 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_backups = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_gigabytes = 1000 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_groups = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_snapshots = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] quota_volumes = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] rate_limit_burst = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] rate_limit_except_level = CRITICAL {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] rate_limit_interval = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] reinit_driver_count = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] replication_device = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] report_discard_supported = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] report_interval = 120 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] reservation_clean_interval = 86400 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] reservation_expire = 86400 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81808]: INFO cinder.volume.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] reserved_image_namespaces = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] reserved_percentage = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] rpc_response_timeout = 120 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] run_external_periodic_tasks = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] scst_target_driver = iscsi {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] scst_target_iqn_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_down_time = 720 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] shell_completion = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] snapshot_name_template = snapshot-%s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] snapshot_same_host = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] split_loggers = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] state_path = /opt/stack/data/cinder {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] storage_availability_zone = nova {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] storage_protocol = iSCSI {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] syslog_log_facility = LOG_USER {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] target_helper = lioadm {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] target_ip_address = 192.168.122.136 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] target_port = 3260 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] target_protocol = iscsi {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] target_secondary_ip_addresses = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] trace_flags = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] transport_url = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] until_refresh = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_chap_auth = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_default_quota_class = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_journal = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_json = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_multipath_for_image_xfer = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_stderr = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] use_syslog = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] verify_glance_signatures = enabled {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_api_class = cinder.volume.api.API {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_backend_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_clear = zero {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_clear_ionice = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_clear_size = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_copy_bps_limit = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_dd_blocksize = 1M {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_name_template = volume-%s {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_service_inithost_offload = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volume_usage_audit_period = month {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] zoning_mode = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_concurrency.disable_process_locking = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.admin_password = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.admin_token = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.admin_user = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_port = 35357 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_protocol = https {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_section = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_type = password {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_uri = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.auth_version = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.cache = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.identity_uri = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.include_service_catalog = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.insecure = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.interface = public {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_password = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcache_username = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.region_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.service_type = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.backend = dogpile.cache.null {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.backend_argument = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.backend_expiration_time = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.config_prefix = cache.oslo {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.061s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.debug_cache_backend = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.enable_retry_client = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.enable_socket_keepalive = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.enforce_fips_mode = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.expiration_time = 600 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.hashclient_retry_attempts = 2 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_dead_retry = 300 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_sasl_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.password = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.proxies = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.redis_db = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.redis_server = localhost:6379 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.retry_attempts = 2 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.retry_delay = 0.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.socket_keepalive_count = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.socket_keepalive_idle = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.socket_keepalive_interval = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.socket_timeout = 1.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.tls_allowed_ciphers = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.tls_cafile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.tls_certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.tls_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.tls_keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cache.username = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.asyncio_connection = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.asyncio_slave_connection = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.backend = sqlalchemy {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.connection = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.connection_debug = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.connection_parameters = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.connection_recycle_time = 3600 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.connection_trace = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.db_inc_retry_interval = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.db_max_retries = 20 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.db_max_retry_interval = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.db_retry_interval = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.max_overflow = 50 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.max_pool_size = 5 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.max_retries = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.mysql_wsrep_sync_wait = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.pool_timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.retry_interval = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.slave_connection = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.sqlite_synchronous = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.synchronous_reader = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] database.use_db_reconnect = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.connection_string = messaging:// {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.es_doc_type = notification {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.es_scroll_size = 10000 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.es_scroll_time = 2m {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:41 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.filter_error_trace = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.hmac_keys = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.sentinel_service_name = mymaster {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.socket_timeout = 0.1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.trace_requests = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler.trace_sqlalchemy = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler_jaeger.process_tags = {} {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler_jaeger.service_name_prefix = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] profiler_otlp.service_name_prefix = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.enforce_new_defaults = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: WARNING oslo_config.cfg [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.enforce_scope = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:41 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.policy_default_rule = default {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.policy_file = policy.yaml {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] coordination.backend_url = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.group = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.helper_command = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] privsep_osbrick.user = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.group = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.helper_command = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] cinder_sys_admin.user = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.auth_section = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.auth_type = password {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.cafile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.collect_timing = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.insecure = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.send_service_user_token = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.split_loggers = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] service_user.timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.auth_section = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.auth_type = password {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.collect_timing = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.insecure = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.region_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.split_loggers = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] glance.timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.backend_availability_zone = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.chap_password = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.chap_username = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.disk_geometry = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.driver_client_cert = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.driver_client_cert_key = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.driver_data_namespace = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.driver_use_ssl = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.extra_capabilities = {} {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.filter_function = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.goodness_function = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.iscsi_target_flags = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.iscsi_write_cache = on {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.iser_helper = tgtadm {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.iser_port = 3260 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.lvm_mirrors = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.lvm_share_target = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.lvm_type = auto {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.num_shell_tries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.replication_device = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.report_discard_supported = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.reserved_percentage = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.target_helper = tgtadm {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.target_port = 3260 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.target_protocol = iscsi {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.trace_flags = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.unique_fqdn_network = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.use_chap_auth = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_backend_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_clear = zero {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_clear_ionice = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_clear_size = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volume_group = cinder-volumes {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_reports.file_event_handler = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_reports.log_dir = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.backend_host = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack sudo[81816]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.chap_password = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.chap_username = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.chiscsi_conf = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.disk_geometry = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.driver_client_cert = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.driver_use_ssl = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.extra_capabilities = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.filter_function = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.goodness_function = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.iser_helper = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.iser_ip_address = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.iser_port = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.lvm_conf_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack sudo[82014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.lvm_mirrors = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.lvm_share_target = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.lvm_type = auto {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.num_shell_tries = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack sudo[82014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.nvmet_port_id = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.replication_device = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.report_discard_supported = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.reserved_percentage = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.scst_target_driver = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.storage_protocol = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.target_helper = lioadm {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.target_ip_address = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.target_port = 3260 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.target_protocol = iscsi {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.trace_flags = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.use_chap_auth = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_clear = zero {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_clear_size = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] lvmdriver-1.volumes_dir = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.ssl = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_notifications.driver = [] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_notifications.retry = -1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] key_manager.fixed_key = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.barbican_api_version = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.barbican_endpoint = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.barbican_endpoint_type = public {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.barbican_region_name = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.cafile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.collect_timing = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.insecure = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.number_of_retries = 60 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.retry_delay = 1 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.send_service_user_token = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.split_loggers = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.verify_ssl = True {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican.verify_ssl_path = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.auth_section = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.auth_type = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.cafile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.certfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.collect_timing = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.insecure = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.keyfile = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.split_loggers = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] barbican_service_user.timeout = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.approle_role_id = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.approle_secret_id = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.kv_mountpoint = secret {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.kv_path = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.kv_version = 2 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.namespace = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.root_token_id = **** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.ssl_ca_crt_file = None {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.timeout = 60.0 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.use_ssl = False {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:34:42 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] ******************************************************************************** {{(pid=81638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.767s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:42 devstack sudo[82014]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.629s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:34:42 devstack cinder-volume[81808]: INFO cinder.brick.local_dev.lvm [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:42 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:42 devstack sudo[82207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:34:42 devstack sudo[82207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:43 devstack sudo[82207]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:43 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:43 devstack cinder-volume[81808]: DEBUG cinder.brick.local_dev.lvm [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81808) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 12 04:34:43 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:43 devstack sudo[82378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:43 devstack sudo[82378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:44 devstack sudo[82378]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:44 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.214s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:44 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:44 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:44 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:44 devstack sudo[82570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:44 devstack sudo[82570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:45 devstack sudo[82570]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:45 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.877s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:45 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:45 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:45 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:45 devstack sudo[82600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 12 04:34:45 devstack sudo[82600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:46 devstack sudo[82600]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:46 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.691s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:46 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:46 devstack sudo[82604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:34:46 devstack sudo[82604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:46 devstack sudo[82604]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:46 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:46 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:47 devstack sudo[82611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:34:47 devstack sudo[82611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:47 devstack sudo[82611]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:47 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:47 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:47 devstack sudo[82614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:47 devstack sudo[82614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:48 devstack sudo[82614]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:48 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:48 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:48 devstack sudo[82619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:48 devstack sudo[82619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:48 devstack sudo[82619]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:48 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:48 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:49 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:49 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:49 devstack sudo[82627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:49 devstack sudo[82627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:50 devstack sudo[82627]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.064s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:50 devstack cinder-volume[81808]: INFO cinder.volume.drivers.lvm [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:50 devstack sudo[82689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:50 devstack sudo[82689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:50 devstack sudo[82689]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:34:50 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:50 devstack sudo[82750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:34:50 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:51 devstack cinder-volume[81638]: DEBUG dbcounter [-] [81638] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81638) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:34:51 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:51 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:51 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:51 devstack sudo[82893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:51 devstack sudo[82893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:52 devstack sudo[82893]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:52 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:52 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:52 devstack sudo[82900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:52 devstack sudo[82900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:52 devstack sudo[82900]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:52 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:52 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:52 devstack sudo[82903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:52 devstack sudo[82903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:53 devstack sudo[82903]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:53 devstack cinder-volume[81808]: INFO cinder.volume.driver [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Driver hasn't implemented _init_vendor_properties() Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG cinder.volume.driver [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81808) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG oslo_db.sqlalchemy.engines [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81808) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writer thread running {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG cinder.db.sqlalchemy.api [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Building query based on filter {{(pid=81808) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG cinder.image.image_utils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81808) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 12 04:34:53 devstack cinder-volume[81808]: INFO cinder.keymgr.migration [None req-03705f2d-2611-48d0-bba5-10d969375559 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:53 devstack sudo[82907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:34:53 devstack sudo[82907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:53 devstack sudo[82907]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:53 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:53 devstack sudo[82910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:53 devstack sudo[82910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:54 devstack sudo[82910]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:54 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:54 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:54 devstack sudo[82913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:54 devstack sudo[82913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:55 devstack sudo[82913]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:55 devstack sudo[82921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:55 devstack sudo[82921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:55 devstack sudo[82921]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG cinder.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Notifying Schedulers of capabilities ... {{(pid=81808) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:34:55 devstack cinder-volume[81808]: INFO cinder.volume.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Driver initialization completed successfully. Jun 12 04:34:55 devstack cinder-volume[81808]: INFO cinder.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Initiating service 2 cleanup Jun 12 04:34:55 devstack cinder-volume[81808]: INFO cinder.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Service 2 cleanup completed. Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG cinder.service [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Creating RPC server for service cinder-volume {{(pid=81808) start /opt/stack/cinder/cinder/service.py:231}} Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG cinder.service [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81808) start /opt/stack/cinder/cinder/service.py:237}} Jun 12 04:34:55 devstack cinder-volume[81808]: INFO cinder.volume.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:34:55 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:55 devstack sudo[82924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:34:55 devstack sudo[82924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:56 devstack sudo[82924]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:56 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:56 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:56 devstack sudo[82928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:56 devstack sudo[82928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:57 devstack sudo[82928]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:57 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:57 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:57 devstack sudo[82931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:34:57 devstack sudo[82931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:57 devstack sudo[82931]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:57 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:57 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:34:57 devstack sudo[82988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:34:57 devstack sudo[82988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:34:58 devstack sudo[82988]: pam_unix(sudo:session): session closed for user root Jun 12 04:34:58 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:34:58 devstack cinder-volume[81808]: INFO cinder.volume.manager [None req-8cfcb28a-d95d-4cbb-a717-7559872ff045 None None] Driver post RPC initialization completed successfully. Jun 12 04:35:08 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writing DB stats cinder:SELECT=3 {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:35:08 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:35:25 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager._thread_info {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:35:25 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread count: 6 {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:35:25 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread info: [<_MainThread(MainThread, started 130746676891776)>, , , , , ] {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:36:25 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:36:25 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:36:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:36:25 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:36:25 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:36:25 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Jun 12 04:36:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:36:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:36:26 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:36:26 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:36:26 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Jun 12 04:36:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:36:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:36:26 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:36:26 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:36:27 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:36:27 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:36:27 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:36:27 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG cinder.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Notifying Schedulers of capabilities ... {{(pid=81808) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager._thread_info {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread count: 6 {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:36:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread info: [<_MainThread(MainThread, started 130746676891776)>, , , , , ] {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:37:08 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writing DB stats cinder:SELECT=1 {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:37:08 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writing DB stats cinder:UPDATE=1 {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:37:25 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:37:25 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:37:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:37:25 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:37:25 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:37:25 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Jun 12 04:37:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:37:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:37:25 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:37:25 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:37:26 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Jun 12 04:37:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:37:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:37:26 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:37:26 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:37:27 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.577s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:37:27 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:37:27 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:37:27 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG cinder.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Notifying Schedulers of capabilities ... {{(pid=81808) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager._thread_info {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread count: 6 {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:37:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread info: [<_MainThread(MainThread, started 130746676891776)>, , , , , ] {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:38:25 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:38:25 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:38:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:38:25 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:38:25 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:38:26 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Jun 12 04:38:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:38:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:38:26 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:38:26 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:38:26 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Jun 12 04:38:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:38:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:38:26 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:38:26 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:38:27 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:38:27 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:38:27 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:38:27 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG cinder.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Notifying Schedulers of capabilities ... {{(pid=81808) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager._thread_info {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread count: 6 {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:38:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread info: [<_MainThread(MainThread, started 130746676891776)>, , , , , ] {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:39:08 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writing DB stats cinder:SELECT=1 {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:39:08 devstack cinder-volume[81808]: DEBUG dbcounter [-] [81808] Writing DB stats cinder:UPDATE=1 {{(pid=81808) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:39:25 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:39:25 devstack cinder-volume[81808]: DEBUG cinder.volume.drivers.lvm [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Updating volume stats {{(pid=81808) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 12 04:39:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:25 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 12 04:39:25 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:25 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:25 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:26 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:39:26 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:26 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:26 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:26 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 12 04:39:26 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:27 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.566s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:27 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 12 04:39:27 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:27 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG oslo_concurrency.processutils [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=81808) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG cinder.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Notifying Schedulers of capabilities ... {{(pid=81808) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG oslo_service.periodic_task [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] Running periodic task VolumeManager._thread_info {{(pid=81808) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread count: 6 {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:39:27 devstack cinder-volume[81808]: DEBUG cinder.volume.manager [None req-71d7f122-12c9-4259-8f27-bccae2525ced None None] thread info: [<_MainThread(MainThread, started 130746676891776)>, , , , , ] {{(pid=81808) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:39:37 devstack cinder-volume[81638]: INFO oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Caught SIGTERM, stopping children Jun 12 04:39:37 devstack cinder-volume[81638]: DEBUG oslo_concurrency.lockutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Acquiring lock "singleton_lock" {{(pid=81638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:39:37 devstack cinder-volume[81638]: DEBUG oslo_concurrency.lockutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Acquired lock "singleton_lock" {{(pid=81638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:39:37 devstack cinder-volume[81638]: DEBUG oslo_concurrency.lockutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Releasing lock "singleton_lock" {{(pid=81638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:39:37 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Stop services. {{(pid=81638) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 12 04:39:37 devstack cinder-volume[81638]: DEBUG oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Killing children. {{(pid=81638) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 12 04:39:37 devstack cinder-volume[81638]: INFO oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Waiting on 1 children to exit Jun 12 04:39:40 devstack cinder-volume[81808]: DEBUG oslo_concurrency.lockutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Acquiring lock "singleton_lock" {{(pid=81808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:39:40 devstack cinder-volume[81808]: DEBUG oslo_concurrency.lockutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Acquired lock "singleton_lock" {{(pid=81808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:39:40 devstack cinder-volume[81808]: DEBUG oslo_concurrency.lockutils [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Releasing lock "singleton_lock" {{(pid=81808) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:39:40 devstack cinder-volume[81808]: WARNING amqp [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 12 04:39:40 devstack cinder-volume[81808]: WARNING amqp [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 12 04:39:40 devstack cinder-volume[81638]: INFO oslo_service.backend._eventlet.service [None req-f65f3fac-54b2-4ae2-898b-1b070182ab14 None None] Child 81808 exited with status 0 Jun 12 04:39:43 devstack cinder-volume[91570]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91570) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:39:43 devstack cinder-volume[91570]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91570) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:39:43 devstack cinder-volume[91570]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91570) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:39:43 devstack cinder-volume[91570]: INFO dbcounter [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Registered counter for database cinder Jun 12 04:39:43 devstack cinder-volume[91570]: DEBUG oslo_db.sqlalchemy.engines [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91570) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG dbcounter [-] [91570] Writer thread running {{(pid=91570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 12 04:39:44 devstack cinder-volume[91570]: INFO cinder.rpc [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 12 04:39:44 devstack cinder-volume[91570]: INFO cinder.rpc [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_db.sqlalchemy.engines [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91570) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:39:44 devstack cinder-volume[91570]: INFO cinder.volume.manager [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Determined volume DB was empty at startup. Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG cinder.volume.manager [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91570) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 12 04:39:44 devstack cinder-volume[91570]: INFO cinder.volume.manager [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 12 04:39:44 devstack cinder-volume[91570]: WARNING stevedore.named [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 12 04:39:44 devstack cinder-volume[91570]: WARNING castellan.key_manager [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:39:44 devstack cinder-volume[91570]: WARNING cinder.keymgr.conf_key_mgr [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:39:44 devstack cinder-volume[91570]: INFO cinder.volume.manager [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_db.sqlalchemy.engines [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91570) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:39:44 devstack cinder-volume[91570]: INFO oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Starting 1 workers Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Started child 91708 {{(pid=91570) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Full set of CONF: {{(pid=91570) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] ******************************************************************************** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Configuration options gathered from: {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] ================================================================================ {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] allow_availability_zone_fallback = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] allow_compression_on_image_upload = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] allowed_direct_url_schemes = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] api_rate_limit = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] auth_strategy = keystone {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_availability_zone = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_host = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91708]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_stats_polling_interval = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backup_api_class = cinder.backup.api.API {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backup_name_template = backup-%s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backup_use_same_host = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backup_use_temp_snapshot = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] chap_password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] chap_username = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_internal_tenant_project_id = 5056e03a4ed040509c808b8f1b00c56a {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_internal_tenant_user_id = 7bfd0da3b97e4cafa475e4212c04d57c {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cluster = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] compression_format = gzip {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] compute_api_class = cinder.compute.nova.API {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] config_dir = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] config_source = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] control_exchange = openstack {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] debug = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] default_availability_zone = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] default_group_type = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] default_volume_type = QuobyteHD {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] disk_geometry = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] driver_client_cert = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] driver_client_cert_key = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] driver_data_namespace = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] driver_ssl_cert_path = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] driver_ssl_cert_verify = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] driver_use_ssl = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] enable_new_services = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] enable_unsupported_driver = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] enabled_backends = ['QuobyteHD'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] enforce_multipath_for_image_xfer = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] filter_function = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_api_insecure = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_api_ssl_compression = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_ca_certificates_file = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_catalog_info = image:glance:publicURL {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_num_retries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance_request_timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] goodness_function = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] graceful_shutdown_timeout = 5 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] group_api_class = cinder.group.api.API {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] host = devstack {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_compress_on_upload = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_conversion_address_space_limit = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_conversion_cpu_limit = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_conversion_disable = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_upload_use_cinder_backend = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_upload_use_internal_tenant = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_volume_cache_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_volume_cache_max_count = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] image_volume_cache_max_size_gb = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] init_host_max_objects_retrieval = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] instance_format = [instance: %(uuid)s] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] iscsi_target_flags = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] iscsi_write_cache = on {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] iser_helper = tgtadm {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] iser_ip_address = 192.168.122.136 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] iser_port = 3260 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_color = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_config_append = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_dir = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_file = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_options = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_rotate_interval = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_rotate_interval_type = days {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] log_rotation_type = none {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] max_age = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] max_logfile_count = 30 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] max_logfile_size_mb = 200 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] max_over_subscription_ratio = 20.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] message_reap_interval = 86400 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] message_ttl = 2592000 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] migration_create_volume_timeout_secs = 300 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] monkey_patch = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] monkey_patch_modules = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] my_ip = 192.168.122.136 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] no_snapshot_gb_quota = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91708]: INFO cinder.volume.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.remotefs [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91708) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] num_iser_scan_tries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] num_shell_tries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] num_volume_device_scan_tries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] nvmeof_conn_info_version = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] nvmet_ns_id = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] nvmet_port_id = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_max_limit = 1000 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_volume_ext_list = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_volume_listen = 0.0.0.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_volume_listen_port = 8776 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_volume_use_ssl = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] osapi_volume_workers = 2 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] per_volume_size_limit = -1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] periodic_fuzzy_delay = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] periodic_interval = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] project_id_regex = [0-9a-f\-]+ {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] public_endpoint = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] publish_errors = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_backup_gigabytes = 1000 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_backups = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_gigabytes = 1000 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_groups = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_snapshots = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] quota_volumes = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] rate_limit_burst = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] rate_limit_except_level = CRITICAL {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] rate_limit_interval = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] reinit_driver_count = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] replication_device = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] report_discard_supported = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] report_interval = 120 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] reservation_clean_interval = 86400 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] reservation_expire = 86400 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] reserved_image_namespaces = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] reserved_percentage = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] rpc_response_timeout = 120 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] run_external_periodic_tasks = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] scst_target_driver = iscsi {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] scst_target_iqn_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_down_time = 720 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] shell_completion = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] snapshot_name_template = snapshot-%s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] split_loggers = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] state_path = /opt/stack/data/cinder {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] storage_availability_zone = nova {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] storage_protocol = iSCSI {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] syslog_log_facility = LOG_USER {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] target_helper = lioadm {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] target_ip_address = 192.168.122.136 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] target_port = 3260 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] target_protocol = iscsi {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] target_secondary_ip_addresses = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] trace_flags = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] transfer_api_class = cinder.transfer.api.API {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] transport_url = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] until_refresh = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_chap_auth = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_default_quota_class = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_journal = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_json = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_multipath_for_image_xfer = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_stderr = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] use_syslog = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] verify_glance_signatures = enabled {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_api_class = cinder.volume.api.API {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_backend_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_clear = zero {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_clear_ionice = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_clear_size = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_copy_bps_limit = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_dd_blocksize = 1M {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_name_template = volume-%s {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_service_inithost_offload = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volume_usage_audit_period = month {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] zoning_mode = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_concurrency.disable_process_locking = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.admin_password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.admin_token = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.admin_user = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_admin_prefix = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_port = 35357 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_protocol = https {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_section = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_type = password {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_uri = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.auth_version = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.cache = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.delay_auth_decision = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.http_connect_timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.identity_uri = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.include_service_catalog = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.insecure = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.interface = public {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_password = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91708) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 12 04:39:44 devstack cinder-volume[91708]: WARNING cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 12 04:39:44 devstack cinder-volume[91708]: WARNING cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcache_username = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.region_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.service_token_roles_required = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.service_type = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.token_cache_time = 300 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Running cmd (subprocess): mount.quobyte {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.backend = dogpile.cache.null {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.backend_argument = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.backend_expiration_time = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.config_prefix = cache.oslo {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.debug_cache_backend = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.enable_retry_client = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.enable_socket_keepalive = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.enforce_fips_mode = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.expiration_time = 600 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.hashclient_retry_attempts = 2 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_dead_retry = 300 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_pool_maxsize = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_sasl_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.proxies = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.redis_db = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.redis_sentinel_service_name = mymaster {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.redis_server = localhost:6379 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.retry_attempts = 2 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.retry_delay = 0.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.socket_keepalive_count = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.socket_keepalive_idle = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.socket_keepalive_interval = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.socket_timeout = 1.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.tls_allowed_ciphers = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.tls_cafile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.tls_certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.tls_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.tls_keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cache.username = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.asyncio_connection = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.asyncio_slave_connection = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.backend = sqlalchemy {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.connection = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.connection_debug = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.connection_parameters = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.connection_recycle_time = 3600 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.connection_trace = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.db_inc_retry_interval = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.db_max_retries = 20 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.db_max_retry_interval = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.db_retry_interval = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.max_overflow = 50 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.max_pool_size = 5 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.max_retries = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.mysql_wsrep_sync_wait = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.pool_timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.retry_interval = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.slave_connection = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.sqlite_synchronous = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.synchronous_reader = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] database.use_db_reconnect = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.connection_string = messaging:// {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.es_doc_type = notification {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.es_scroll_size = 10000 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.es_scroll_time = 2m {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.filter_error_trace = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.hmac_keys = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.sentinel_service_name = mymaster {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.socket_timeout = 0.1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.trace_requests = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler.trace_sqlalchemy = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler_jaeger.process_tags = {} {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler_jaeger.service_name_prefix = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] profiler_otlp.service_name_prefix = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.enforce_new_defaults = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: WARNING oslo_config.cfg [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.enforce_scope = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.policy_default_rule = default {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.policy_file = policy.yaml {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_policy.remote_timeout = 60.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] coordination.backend_url = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.group = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.helper_command = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] privsep_osbrick.user = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.group = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.helper_command = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] cinder_sys_admin.user = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.auth_section = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.auth_type = password {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.cafile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.collect_timing = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.insecure = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.send_service_user_token = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.split_loggers = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] service_user.timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.auth_section = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.auth_type = password {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.collect_timing = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.insecure = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.region_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.split_loggers = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] glance.timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.backend_availability_zone = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.chap_password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.chap_username = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.disk_geometry = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.driver_client_cert = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.driver_client_cert_key = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.driver_data_namespace = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.driver_use_ssl = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.enable_unsupported_driver = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.extra_capabilities = {} {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.filter_function = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.goodness_function = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.iscsi_target_flags = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.iscsi_write_cache = on {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.iser_helper = tgtadm {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.iser_port = 3260 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_host = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_login = admin {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_mount_options = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_private_key = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_share_path = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_ssh_port = 22 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.num_shell_tries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.nvmet_port_id = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_client_cfg = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.quobyte_volume_url = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.replication_device = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.report_discard_supported = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.reserved_percentage = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.scst_target_driver = iscsi {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.scst_target_iqn_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.storage_protocol = iSCSI {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.target_helper = tgtadm {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.target_port = 3260 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.target_protocol = iscsi {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.trace_flags = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.unique_fqdn_network = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.use_chap_auth = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_backend_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_clear = zero {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_clear_ionice = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_clear_size = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_reports.file_event_handler = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_reports.log_dir = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.backend_availability_zone = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.backend_host = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.chap_password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.chap_username = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.chiscsi_conf = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.disk_geometry = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.driver_client_cert = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.driver_client_cert_key = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.driver_data_namespace = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.driver_use_ssl = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.extra_capabilities = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.filter_function = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.goodness_function = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.iscsi_target_flags = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.iscsi_write_cache = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.iser_helper = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.iser_ip_address = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.iser_port = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.iser_target_prefix = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_host = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_login = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_mount_options = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_password = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_private_key = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_share_path = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_ssh_port = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.num_shell_tries = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nvmet_ns_id = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.nvmet_port_id = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack quobyte-client[91788]: Reading configuration file: /etc/quobyte/client.cfg Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack quobyte-client[91788]: Invalid parameters found, error: missing mount point. Jun 12 04:39:44 devstack quobyte-client[91788]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.replication_device = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.report_discard_supported = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.reserved_percentage = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.scst_target_driver = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.storage_protocol = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack quobyte-client[91788]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.target_helper = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] CMD "mount.quobyte" returned: 1 in 0.198s {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.target_ip_address = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.target_port = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.target_prefix = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.target_protocol = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=91708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.trace_flags = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.unique_fqdn_network = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.use_chap_auth = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_clear = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_clear_ionice = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_clear_size = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] QuobyteHD.volumes_dir = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: INFO cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 ... Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 -c /etc/quobyte/client-cinder.cfg {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.ssl = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.ssl_version = {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_notifications.driver = [] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_notifications.retry = -1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] oslo_messaging_notifications.transport_url = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] key_manager.fixed_key = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.barbican_api_version = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.barbican_endpoint = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.barbican_endpoint_type = public {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.barbican_region_name = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.cafile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.collect_timing = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.insecure = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.number_of_retries = 60 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.retry_delay = 1 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.send_service_user_token = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.split_loggers = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.verify_ssl = True {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican.verify_ssl_path = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.auth_section = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.auth_type = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.cafile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.certfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.collect_timing = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.insecure = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.keyfile = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.split_loggers = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] barbican_service_user.timeout = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.approle_role_id = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.approle_secret_id = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.kv_mountpoint = secret {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.kv_path = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.kv_version = 2 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.namespace = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.root_token_id = **** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.ssl_ca_crt_file = None {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.timeout = 60.0 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.use_ssl = False {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:39:44 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] ******************************************************************************** {{(pid=91570) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 12 04:39:44 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 -c /etc/quobyte/client-cinder.cfg Jun 12 04:39:44 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:45 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:45 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.765s {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:45 devstack cinder-volume[91708]: INFO cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 succeeded Jun 12 04:39:45 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=91708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:39:45 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.781s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:39:45 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:45 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:39:45 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:46 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.593s {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:46 devstack cinder-volume[91708]: INFO cinder.volume.driver [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Driver hasn't implemented _init_vendor_properties() Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG cinder.volume.driver [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91708) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_db.sqlalchemy.engines [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91708) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG dbcounter [-] [91708] Writer thread running {{(pid=91708) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG cinder.db.sqlalchemy.api [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Building query based on filter {{(pid=91708) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG cinder.image.image_utils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91708) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 12 04:39:46 devstack cinder-volume[91708]: INFO cinder.keymgr.migration [None req-13faee77-4fda-45af-8f4f-5cf27e964f8e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=91708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=91708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:46 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:39:46 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:46 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.658s {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:46 devstack cinder-volume[91708]: DEBUG cinder.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Notifying Schedulers of capabilities ... {{(pid=91708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:39:46 devstack cinder-volume[91708]: INFO cinder.volume.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Driver initialization completed successfully. Jun 12 04:39:46 devstack cinder-volume[91708]: INFO cinder.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Initiating service 3 cleanup Jun 12 04:39:47 devstack cinder-volume[91708]: INFO cinder.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Service 3 cleanup completed. Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG cinder.service [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Creating RPC server for service cinder-volume {{(pid=91708) start /opt/stack/cinder/cinder/service.py:231}} Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG cinder.service [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91708) start /opt/stack/cinder/cinder/service.py:237}} Jun 12 04:39:47 devstack cinder-volume[91708]: INFO cinder.volume.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=91708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=91708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:39:47 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:47 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:39:47 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:48 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:48 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.886s {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:48 devstack cinder-volume[91708]: INFO cinder.volume.manager [None req-0d2d67a5-64f4-414e-a8cb-f44af4b73353 None None] Driver post RPC initialization completed successfully. Jun 12 04:39:49 devstack cinder-volume[91708]: DEBUG oslo_service.periodic_task [None req-42618a2c-19d8-4049-aa37-c0c472d5821a None None] Running periodic task VolumeManager._thread_info {{(pid=91708) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:39:49 devstack cinder-volume[91708]: DEBUG cinder.volume.manager [None req-42618a2c-19d8-4049-aa37-c0c472d5821a None None] thread count: 6 {{(pid=91708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:39:49 devstack cinder-volume[91708]: DEBUG cinder.volume.manager [None req-42618a2c-19d8-4049-aa37-c0c472d5821a None None] thread info: [<_MainThread(MainThread, started 123618276446336)>, , , , , ] {{(pid=91708) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:39:50 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:39:50 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:39:50 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=91708) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:39:50 devstack cinder-volume[91708]: DEBUG cinder.volume.drivers.quobyte [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=91708) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:39:50 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91708) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:39:50 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:39:50 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:39:50 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:39:51 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Jun 12 04:39:51 devstack cinder-volume[91708]: DEBUG oslo_concurrency.processutils [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.586s {{(pid=91708) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:39:51 devstack cinder-volume[91708]: DEBUG cinder.manager [None req-321b7f97-0b34-467a-ac1a-cc21103f5041 None None] Notifying Schedulers of capabilities ... {{(pid=91708) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:39:54 devstack cinder-volume[91570]: DEBUG dbcounter [-] [91570] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91570) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:39:54 devstack cinder-volume[91570]: INFO oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Caught SIGTERM, stopping children Jun 12 04:39:54 devstack cinder-volume[91570]: DEBUG oslo_concurrency.lockutils [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Acquiring lock "singleton_lock" {{(pid=91570) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:39:54 devstack cinder-volume[91570]: DEBUG oslo_concurrency.lockutils [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Acquired lock "singleton_lock" {{(pid=91570) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:39:54 devstack cinder-volume[91570]: DEBUG oslo_concurrency.lockutils [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Releasing lock "singleton_lock" {{(pid=91570) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:39:54 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Stop services. {{(pid=91570) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 12 04:39:54 devstack cinder-volume[91570]: DEBUG oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Killing children. {{(pid=91570) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 12 04:39:54 devstack cinder-volume[91570]: INFO oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Waiting on 1 children to exit Jun 12 04:39:55 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Acquiring lock "singleton_lock" {{(pid=91708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:39:55 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Acquired lock "singleton_lock" {{(pid=91708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:39:55 devstack cinder-volume[91708]: DEBUG oslo_concurrency.lockutils [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Releasing lock "singleton_lock" {{(pid=91708) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:39:55 devstack cinder-volume[91708]: WARNING amqp [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 12 04:39:55 devstack cinder-volume[91708]: WARNING amqp [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 12 04:39:55 devstack cinder-volume[91570]: INFO oslo_service.backend._eventlet.service [None req-662e6055-d0d2-45cc-9816-b890d5ab6cbc None None] Child 91708 exited with status 0 Jun 12 04:39:59 devstack cinder-volume[92064]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 12 04:39:59 devstack cinder-volume[92064]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 12 04:39:59 devstack cinder-volume[92064]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 12 04:40:00 devstack cinder-volume[92064]: INFO dbcounter [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Registered counter for database cinder Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_db.sqlalchemy.engines [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG dbcounter [-] [92064] Writer thread running {{(pid=92064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 12 04:40:00 devstack cinder-volume[92064]: INFO cinder.rpc [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 12 04:40:00 devstack cinder-volume[92064]: INFO cinder.rpc [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_db.sqlalchemy.engines [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:40:00 devstack cinder-volume[92064]: INFO cinder.volume.manager [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Determined volume DB was empty at startup. Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG cinder.volume.manager [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92064) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 12 04:40:00 devstack cinder-volume[92064]: WARNING stevedore.named [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 12 04:40:00 devstack cinder-volume[92064]: WARNING castellan.key_manager [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:40:00 devstack cinder-volume[92064]: WARNING cinder.keymgr.conf_key_mgr [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 12 04:40:00 devstack cinder-volume[92064]: INFO cinder.volume.manager [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_db.sqlalchemy.engines [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:40:00 devstack cinder-volume[92064]: INFO oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Starting 1 workers Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Started child 92320 {{(pid=92064) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Full set of CONF: {{(pid=92064) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] ******************************************************************************** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Configuration options gathered from: {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 12 04:40:00 devstack cinder-volume[92320]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] ================================================================================ {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] allow_availability_zone_fallback = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] allow_compression_on_image_upload = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] allowed_direct_url_schemes = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] api_rate_limit = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] auth_strategy = keystone {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_availability_zone = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_host = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_stats_polling_interval = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backup_api_class = cinder.backup.api.API {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backup_name_template = backup-%s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backup_use_same_host = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backup_use_temp_snapshot = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] chap_password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] chap_username = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_internal_tenant_project_id = 5056e03a4ed040509c808b8f1b00c56a {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_internal_tenant_user_id = 7bfd0da3b97e4cafa475e4212c04d57c {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cluster = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] compression_format = gzip {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] compute_api_class = cinder.compute.nova.API {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] config_dir = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] config_source = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] control_exchange = openstack {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] debug = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] default_availability_zone = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] default_group_type = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] default_volume_type = QuobyteHD {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] disk_geometry = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] driver_client_cert = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] driver_client_cert_key = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] driver_data_namespace = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] driver_ssl_cert_path = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] driver_ssl_cert_verify = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] driver_use_ssl = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] enable_new_services = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] enable_unsupported_driver = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] enabled_backends = ['QuobyteHD'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] enforce_multipath_for_image_xfer = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] filter_function = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_api_insecure = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_api_servers = ['http://192.168.122.136/image'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_api_ssl_compression = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_ca_certificates_file = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_catalog_info = image:glance:publicURL {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Starting volume driver QuobyteDriver (1.1.14) Jun 12 04:40:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92320) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_num_retries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance_request_timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] goodness_function = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] graceful_shutdown_timeout = 5 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] group_api_class = cinder.group.api.API {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] host = devstack {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_compress_on_upload = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_conversion_address_space_limit = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_conversion_cpu_limit = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_conversion_disable = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_upload_use_cinder_backend = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_upload_use_internal_tenant = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_volume_cache_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_volume_cache_max_count = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] image_volume_cache_max_size_gb = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] init_host_max_objects_retrieval = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] instance_format = [instance: %(uuid)s] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] iscsi_target_flags = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] iscsi_write_cache = on {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] iser_helper = tgtadm {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] iser_ip_address = 192.168.122.136 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] iser_port = 3260 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_color = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_config_append = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_dir = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_file = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_options = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_rotate_interval = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_rotate_interval_type = days {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] log_rotation_type = none {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] max_age = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] max_logfile_count = 30 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] max_logfile_size_mb = 200 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] max_over_subscription_ratio = 20.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] message_reap_interval = 86400 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] message_ttl = 2592000 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] migration_create_volume_timeout_secs = 300 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] monkey_patch = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] monkey_patch_modules = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] my_ip = 192.168.122.136 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] no_snapshot_gb_quota = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] num_iser_scan_tries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] num_shell_tries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] num_volume_device_scan_tries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] nvmeof_conn_info_version = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] nvmet_ns_id = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] nvmet_port_id = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_max_limit = 1000 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_volume_ext_list = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_volume_listen_port = 8776 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_volume_use_ssl = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] osapi_volume_workers = 2 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] per_volume_size_limit = -1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] periodic_fuzzy_delay = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] periodic_interval = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] public_endpoint = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] publish_errors = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_backup_gigabytes = 1000 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_backups = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_gigabytes = 1000 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_groups = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_snapshots = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] quota_volumes = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] rate_limit_burst = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] rate_limit_except_level = CRITICAL {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] rate_limit_interval = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] reinit_driver_count = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] replication_device = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] report_discard_supported = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] report_interval = 120 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] reservation_clean_interval = 86400 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] reservation_expire = 86400 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] reserved_image_namespaces = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] reserved_percentage = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] rpc_response_timeout = 120 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] run_external_periodic_tasks = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] scst_target_driver = iscsi {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] scst_target_iqn_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_down_time = 720 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] shell_completion = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] snapshot_name_template = snapshot-%s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] split_loggers = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] state_path = /opt/stack/data/cinder {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] storage_availability_zone = nova {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] storage_protocol = iSCSI {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] syslog_log_facility = LOG_USER {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] target_helper = lioadm {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] target_ip_address = 192.168.122.136 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] target_port = 3260 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] target_protocol = iscsi {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] target_secondary_ip_addresses = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] trace_flags = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] transport_url = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] until_refresh = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_chap_auth = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_default_quota_class = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_journal = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_json = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_multipath_for_image_xfer = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_stderr = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] use_syslog = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] verify_glance_signatures = enabled {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_api_class = cinder.volume.api.API {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_backend_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_clear = zero {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_clear_ionice = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_clear_size = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_copy_bps_limit = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_dd_blocksize = 1M {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_name_template = volume-%s {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_service_inithost_offload = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volume_usage_audit_period = month {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] zoning_mode = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_concurrency.disable_process_locking = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.admin_password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.admin_token = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.admin_user = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_admin_prefix = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_port = 35357 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_protocol = https {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_section = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_type = password {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_uri = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.auth_version = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.cache = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.identity_uri = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.include_service_catalog = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.insecure = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.interface = public {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_password = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92320) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 12 04:40:00 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 12 04:40:00 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcache_username = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.region_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.service_token_roles_required = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.service_type = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Running cmd (subprocess): mount.quobyte {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.136/identity {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.backend = dogpile.cache.null {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.backend_argument = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.backend_expiration_time = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.config_prefix = cache.oslo {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.debug_cache_backend = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.enable_retry_client = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.enable_socket_keepalive = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.enforce_fips_mode = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.expiration_time = 600 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.hashclient_retry_attempts = 2 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_dead_retry = 300 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_pool_maxsize = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:00 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_sasl_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.proxies = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.redis_db = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.redis_server = localhost:6379 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.retry_attempts = 2 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.retry_delay = 0.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.socket_keepalive_count = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.socket_keepalive_idle = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.socket_keepalive_interval = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.socket_timeout = 1.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.tls_allowed_ciphers = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.tls_cafile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.tls_certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.tls_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.tls_keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cache.username = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.asyncio_connection = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.asyncio_slave_connection = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.backend = sqlalchemy {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.connection = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.connection_debug = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.connection_parameters = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.connection_recycle_time = 3600 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.connection_trace = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.db_inc_retry_interval = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.db_max_retries = 20 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.db_max_retry_interval = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.db_retry_interval = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.max_overflow = 50 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.max_pool_size = 5 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.max_retries = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.mysql_wsrep_sync_wait = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.pool_timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.retry_interval = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.slave_connection = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.sqlite_synchronous = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.synchronous_reader = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] database.use_db_reconnect = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.connection_string = messaging:// {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.es_doc_type = notification {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.es_scroll_size = 10000 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.es_scroll_time = 2m {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.filter_error_trace = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.hmac_keys = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.sentinel_service_name = mymaster {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.socket_timeout = 0.1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.trace_requests = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler.trace_sqlalchemy = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler_jaeger.process_tags = {} {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler_jaeger.service_name_prefix = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] profiler_otlp.service_name_prefix = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.enforce_new_defaults = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: WARNING oslo_config.cfg [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.enforce_scope = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.policy_default_rule = default {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.policy_file = policy.yaml {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] coordination.backend_url = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.group = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.helper_command = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] privsep_osbrick.user = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.group = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.helper_command = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] cinder_sys_admin.user = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.auth_section = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.auth_type = password {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.cafile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.collect_timing = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.insecure = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.send_service_user_token = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.split_loggers = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] service_user.timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.auth_section = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.auth_type = password {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.collect_timing = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.insecure = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.region_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.split_loggers = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] glance.timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.backend_availability_zone = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.chap_password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.chap_username = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.disk_geometry = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.driver_client_cert = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.driver_client_cert_key = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.driver_data_namespace = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack quobyte-client[92337]: Reading configuration file: /etc/quobyte/client.cfg Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.driver_use_ssl = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.extra_capabilities = {} {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.filter_function = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack quobyte-client[92337]: Invalid parameters found, error: missing mount point. Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.goodness_function = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack quobyte-client[92337]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.iscsi_target_flags = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.iscsi_write_cache = on {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.iser_helper = tgtadm {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.iser_ip_address = 192.168.122.136 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.iser_port = 3260 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack quobyte-client[92337]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_host = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_login = admin {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_mount_options = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_private_key = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_share_path = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.num_shell_tries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.quobyte_volume_url = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.replication_device = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.report_discard_supported = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.reserved_percentage = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.target_helper = tgtadm {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.target_ip_address = 192.168.122.136 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.target_port = 3260 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.target_protocol = iscsi {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.trace_flags = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.unique_fqdn_network = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.use_chap_auth = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_backend_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_clear = zero {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_clear_ionice = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_clear_size = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_reports.file_event_handler = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_reports.log_dir = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.backend_availability_zone = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.backend_host = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.chap_password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.chap_username = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] CMD "mount.quobyte" returned: 1 in 0.178s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.chiscsi_conf = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.disk_geometry = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.driver_client_cert = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.driver_data_namespace = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.driver_use_ssl = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.extra_capabilities = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.filter_function = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.goodness_function = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.iser_helper = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.iser_ip_address = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.iser_port = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.iser_target_prefix = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_host = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_login = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_mount_options = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_password = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_private_key = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_share_path = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_ssh_port = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.num_shell_tries = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.nvmet_port_id = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:40:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.replication_device = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.report_discard_supported = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.reserved_percentage = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.scst_target_driver = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.storage_protocol = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.target_helper = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.target_ip_address = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.target_port = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.target_prefix = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.target_protocol = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.trace_flags = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.use_chap_auth = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_clear = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_clear_size = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] QuobyteHD.volumes_dir = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.ssl = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_notifications.driver = [] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_notifications.retry = -1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] key_manager.fixed_key = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.barbican_api_version = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.barbican_endpoint = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.barbican_endpoint_type = public {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.barbican_region_name = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.cafile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.collect_timing = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.insecure = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.number_of_retries = 60 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.retry_delay = 1 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.send_service_user_token = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.split_loggers = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.verify_ssl = True {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican.verify_ssl_path = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.auth_section = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.auth_type = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.cafile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.certfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.collect_timing = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.insecure = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.keyfile = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.split_loggers = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] barbican_service_user.timeout = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.approle_role_id = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.approle_secret_id = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.kv_mountpoint = secret {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.kv_path = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.kv_version = 2 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.namespace = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.root_token_id = **** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.ssl_ca_crt_file = None {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.timeout = 60.0 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.use_ssl = False {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 12 04:40:01 devstack cinder-volume[92064]: DEBUG oslo_service.backend._eventlet.service [None req-c8954301-1d32-4c24-8284-2956a2b7ec01 None None] ******************************************************************************** {{(pid=92064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 12 04:40:02 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.866s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:40:02 devstack cinder-volume[92320]: INFO cinder.volume.driver [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Driver hasn't implemented _init_vendor_properties() Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.volume.driver [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92320) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_db.sqlalchemy.engines [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writer thread running {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.db.sqlalchemy.api [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Building query based on filter {{(pid=92320) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92320) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:40:02 devstack cinder-volume[92320]: INFO cinder.keymgr.migration [None req-e83978a0-cd7c-4ccb-b803-c7b0a5a8ebe2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 12 04:40:02 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:40:02 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:40:02 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:40:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Driver initialization completed successfully. Jun 12 04:40:02 devstack cinder-volume[92320]: INFO cinder.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Initiating service 3 cleanup Jun 12 04:40:02 devstack cinder-volume[92320]: INFO cinder.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Service 3 cleanup completed. Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.service [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Creating RPC server for service cinder-volume {{(pid=92320) start /opt/stack/cinder/cinder/service.py:231}} Jun 12 04:40:02 devstack cinder-volume[92320]: DEBUG cinder.service [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92320) start /opt/stack/cinder/cinder/service.py:237}} Jun 12 04:40:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:40:03 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:40:03 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:40:03 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Jun 12 04:40:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.618s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:40:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3b86906e-3adb-4327-92b6-e1b7a692bbbb None None] Driver post RPC initialization completed successfully. Jun 12 04:40:10 devstack cinder-volume[92064]: DEBUG dbcounter [-] [92064] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=92064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:40:12 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:40:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:40:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:40:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 6 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:40:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:41:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-150f3ed0-5651-44d6-9ca6-564d3ea9621f tempest-GroupSnapshotsV319Test-1187230662 None] Group tempest-GroupSnapshotsV319Test-Group-373197952: creating Jun 12 04:41:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-150f3ed0-5651-44d6-9ca6-564d3ea9621f tempest-GroupSnapshotsV319Test-1187230662 None] Group tempest-GroupSnapshotsV319Test-Group-373197952: created successfully Jun 12 04:41:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-150f3ed0-5651-44d6-9ca6-564d3ea9621f tempest-GroupSnapshotsV319Test-1187230662 None] Create group completed successfully. Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Flow 'volume_create_manager' (6c6fc66c-1c5f-4b40-8ecb-349ad602cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752e8f55-aa95-4d75-a0e0-cb23e1ad77e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752e8f55-aa95-4d75-a0e0-cb23e1ad77e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-89585373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b14372f8-c7d2-4c31-862d-07ea51799bab,host='devstack@QuobyteHD#QuobyteHD',id=aac0d582-b593-410c-864d-8eefaac5cb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4556a3ced4748dc952ec85a00ca9649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:04Z,use_quota=True,user_id='125cf6251da64d51a0dcdd998a5449d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6143d704-7c19-4b10-b91f-5e03b8a5fec9),volume_type_id=6143d704-7c19-4b10-b91f-5e03b8a5fec9)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eb013b-9e6e-49b5-ad3e-f92bd73382b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eb013b-9e6e-49b5-ad3e-f92bd73382b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1d8446-1d17-47fc-8260-cb618b0d4508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1d8446-1d17-47fc-8260-cb618b0d4508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac0d582-b593-410c-864d-8eefaac5cb02', 'volume_name': 'volume-aac0d582-b593-410c-864d-8eefaac5cb02', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7ab44-2ccc-4a86-b5e3-77af421be154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf7ab44-2ccc-4a86-b5e3-77af421be154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a2edd-df92-4883-b2bd-e2473371a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Volume aac0d582-b593-410c-864d-8eefaac5cb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac0d582-b593-410c-864d-8eefaac5cb02', 'volume_size': 1} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b14372f8-c7d2-4c31-862d-07ea51799bab,created_at=2026-06-12T02:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-89585373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b14372f8-c7d2-4c31-862d-07ea51799bab,host='devstack@QuobyteHD#QuobyteHD',id=aac0d582-b593-410c-864d-8eefaac5cb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4556a3ced4748dc952ec85a00ca9649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:04Z,use_quota=True,user_id='125cf6251da64d51a0dcdd998a5449d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6143d704-7c19-4b10-b91f-5e03b8a5fec9),volume_type_id=6143d704-7c19-4b10-b91f-5e03b8a5fec9)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Creating volume aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:41:04 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:41:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:04 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 1073741824 Jun 12 04:41:04 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:06 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 1073741824" returned: 0 in 1.574s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:06 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 Jun 12 04:41:06 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:06 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02" returned: 0 in 0.703s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:41:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a2edd-df92-4883-b2bd-e2473371a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac0d582-b593-410c-864d-8eefaac5cb02', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85b589f-5308-4c15-b888-e07d40ba35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:07 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Volume volume-aac0d582-b593-410c-864d-8eefaac5cb02 (aac0d582-b593-410c-864d-8eefaac5cb02): created successfully Jun 12 04:41:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85b589f-5308-4c15-b888-e07d40ba35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Flow 'volume_create_manager' (6c6fc66c-1c5f-4b40-8ecb-349ad602cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c8b2679e-f450-4366-9437-08ac70c5f6fb tempest-GroupSnapshotsV319Test-1187230662 None] Created volume successfully. Jun 12 04:41:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] GroupSnapshot 9aefefda-0022-46a8-bf65-ad86de163ed7: creating. Jun 12 04:41:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Group snapshot 9aefefda-0022-46a8-bf65-ad86de163ed7: creating. {{(pid=92320) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4187}} Jun 12 04:41:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Creating offline snapshot eb7d0208-f0cc-4d98-bae3-6bb72d796044 of volume aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:41:08 devstack cinder-volume[92320]: INFO oslo.privsep.daemon [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphcugb9gf/privsep.sock'] Jun 12 04:41:08 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphcugb9gf/privsep.sock Jun 12 04:41:08 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:09 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:09 devstack cinder-volume[92320]: INFO oslo.privsep.daemon [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Spawned new privsep daemon via rootwrap Jun 12 04:41:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Accepted privsep connection to /tmp/tmphcugb9gf/privsep.sock {{(pid=92320) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 12 04:41:09 devstack cinder-volume[92320]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 12 04:41:09 devstack cinder-volume[92320]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 12 04:41:09 devstack cinder-volume[92320]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 12 04:41:09 devstack cinder-volume[92320]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93259 Jun 12 04:41:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58af8b-5709-4762-9c33-11df7999a10c]: (2,) {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955caff-8a65-45c2-bb19-28eb813f4fcb]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:09 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 Jun 12 04:41:09 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:10 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02" returned: 0 in 0.771s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:10 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 1G Jun 12 04:41:10 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:11 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 1G" returned: 0 in 0.886s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac0d582-b593-410c-864d-8eefaac5cb02 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:11 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac0d582-b593-410c-864d-8eefaac5cb02 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 Jun 12 04:41:11 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:12 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac0d582-b593-410c-864d-8eefaac5cb02 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:12 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:41:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:12 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 Jun 12 04:41:12 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:13 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044" returned: 0 in 0.814s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:13 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info Jun 12 04:41:13 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:13 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info" returned: 0 in 0.838s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:13 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:41:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:13 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info Jun 12 04:41:13 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:14 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.info" returned: 0 in 1.025s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.691s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-135bf79b-654e-4d70-8602-d962336a46b9 tempest-GroupSnapshotsV319Test-1187230662 None] group_snapshot 9aefefda-0022-46a8-bf65-ad86de163ed7: created successfully Jun 12 04:41:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] group_snapshot 9aefefda-0022-46a8-bf65-ad86de163ed7: deleting Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] group_snapshot 9aefefda-0022-46a8-bf65-ad86de163ed7: deleting {{(pid=92320) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4362}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "cinder-quobyte-aac0d582-b593-410c-864d-8eefaac5cb02" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Lock "cinder-quobyte-aac0d582-b593-410c-864d-8eefaac5cb02" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "cinder-quobyte-eb7d0208-f0cc-4d98-bae3-6bb72d796044" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Lock "cinder-quobyte-eb7d0208-f0cc-4d98-bae3-6bb72d796044" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Deleting offline snapshot eb7d0208-f0cc-4d98-bae3-6bb72d796044 of volume aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] snapshot_file for this snap is: volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f65dc-573a-494f-b7bc-7b63ddb91d42]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:17 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 Jun 12 04:41:17 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Flow 'volume_create_manager' (6fe0cede-9f6b-4301-a452-7b94d2291033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3895ced4-a9ce-4923-8c8c-7e4a24a8087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:18 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044" returned: 0 in 1.593s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aac0d582-b593-410c-864d-8eefaac5cb02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3895ced4-a9ce-4923-8c8c-7e4a24a8087f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-845185647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2105e6e-6f8d-4973-a923-9e6d7d9d15ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a7f8f1314b402a9c37bbb826f53b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:18Z,use_quota=True,user_id='a77450c51dc049369c7a12bfcc4b7b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ea7d76-3249-4cd2-88d7-c7dd701a163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ea7d76-3249-4cd2-88d7-c7dd701a163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5259b14-4204-4e12-bc22-bf5db16ccdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5259b14-4204-4e12-bc22-bf5db16ccdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2105e6e-6f8d-4973-a923-9e6d7d9d15ff', 'volume_name': 'volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ce553f-6293-4461-b801-ea331e7bed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ce553f-6293-4461-b801-ea331e7bed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e25674f-2c14-4874-893a-93340c45dd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:18 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Volume e2105e6e-6f8d-4973-a923-9e6d7d9d15ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff', 'volume_size': 1} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-845185647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2105e6e-6f8d-4973-a923-9e6d7d9d15ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a7f8f1314b402a9c37bbb826f53b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:18Z,use_quota=True,user_id='a77450c51dc049369c7a12bfcc4b7b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Creating volume e2105e6e-6f8d-4973-a923-9e6d7d9d15ff {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:41:18 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[667eb066-f807-40b5-9df7-80a2d4778ee0]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:18 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff 1073741824 Jun 12 04:41:18 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:18 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 Jun 12 04:41:18 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:20 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02" returned: 0 in 1.422s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:20 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 Jun 12 04:41:20 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:20 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff 1073741824" returned: 0 in 1.630s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:20 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff Jun 12 04:41:20 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:21 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044" returned: 0 in 1.245s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:21 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044 Jun 12 04:41:21 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:21 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff" returned: 0 in 1.370s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] <== create_volume: return (3109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.118s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e25674f-2c14-4874-893a-93340c45dd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9a161c-2e96-43db-9f63-b7172e9d4ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Volume volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff (e2105e6e-6f8d-4973-a923-9e6d7d9d15ff): created successfully Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9a161c-2e96-43db-9f63-b7172e9d4ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Flow 'volume_create_manager' (6fe0cede-9f6b-4301-a452-7b94d2291033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2ef87dfa-e3fb-4775-900f-c7543ed1e20b tempest-VolumesAdminNegativeTest-146835124 None] Created volume successfully. Jun 12 04:41:22 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02.eb7d0208-f0cc-4d98-bae3-6bb72d796044" returned: 0 in 1.249s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Lock "cinder-quobyte-eb7d0208-f0cc-4d98-bae3-6bb72d796044" released by "_delete_snapshot" :: held 5.769s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:41:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Lock "cinder-quobyte-aac0d582-b593-410c-864d-8eefaac5cb02" released by "delete_snapshot" :: held 5.807s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:41:22 devstack cinder-volume[92320]: WARNING cinder.quota [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-821053292 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-821053292, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:41:22 devstack cinder-volume[92320]: WARNING cinder.quota [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-821053292 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-821053292, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:41:22 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] Created reservations ['169343f7-1c49-40e1-a56a-cc4b9ec197cd', '06920f35-cb9b-4590-908c-f71ff0ff2857', '0ed5df06-392b-456d-aeaa-e3bf14105c01', '7f77dafb-7418-4e3a-8de7-8b714f3b4f17'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:41:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b8a05259-6af9-4afa-82d1-e7c9c04a1fcc tempest-GroupSnapshotsV319Test-1187230662 None] group_snapshot 9aefefda-0022-46a8-bf65-ad86de163ed7: deleted successfully Jun 12 04:41:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Acquiring lock "cinder-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Lock "cinder-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Acquiring lock "cinder-quobyte-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Lock "cinder-quobyte-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff" acquired by "delete_volume" :: waited 0.056s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb8cc9b-9662-4e88-b2ba-fec2049d3987]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "cinder-quobyte-aac0d582-b593-410c-864d-8eefaac5cb02" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Lock "cinder-quobyte-aac0d582-b593-410c-864d-8eefaac5cb02" acquired by "delete_volume" :: waited 0.055s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[37306eba-d8cc-41af-9999-629e1c84522d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:24 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff Jun 12 04:41:24 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:24 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 Jun 12 04:41:24 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:25 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff" returned: 0 in 1.371s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:25 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff Jun 12 04:41:25 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:25 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02" returned: 0 in 1.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:26 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02 Jun 12 04:41:26 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:26 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff" returned: 0 in 1.095s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Lock "cinder-quobyte-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff" released by "delete_volume" :: held 2.543s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:41:26 devstack cinder-volume[92320]: WARNING cinder.quota [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:41:26 devstack cinder-volume[92320]: WARNING cinder.quota [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Created reservations ['289f4838-9271-4aa7-a102-ce6f62b46314', '5d3f1ad8-f8f9-469f-9716-bd3c2138c44c', '94cbbc37-d4fb-414d-aec0-b6ea536edb7c', '9cbef36b-2e55-46a5-aa40-b0a3e1108eee'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:26 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:41:26 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:26 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-aac0d582-b593-410c-864d-8eefaac5cb02" returned: 0 in 1.049s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Lock "cinder-quobyte-aac0d582-b593-410c-864d-8eefaac5cb02" released by "delete_volume" :: held 2.920s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Created reservations ['9169b001-7abf-47ca-a229-3664b58e5956'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:41:27 devstack cinder-volume[92320]: WARNING cinder.quota [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-821053292 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-821053292, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Created reservations ['b3e05ec1-537e-438f-bc93-6078e3968e18', '9b1b3b30-13e6-4ffe-9fe8-4e9574bdaa7b', '1b87f68a-bb6d-4a46-8686-622d5a717716', '2bcd33b6-1b22-4fd6-af95-5e1bd27d2e9a'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:27 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:41:27 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:28 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.409s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:28 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:41:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Deleted volume successfully. Jun 12 04:41:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5dc3554d-3db0-4980-9fbd-99938ea7d7c7 tempest-VolumesAdminNegativeTest-146835124 None] Lock "cinder-e2105e6e-6f8d-4973-a923-9e6d7d9d15ff-delete_volume" released by "delete_volume" :: held 4.661s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:41:28 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.169s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:28 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:41:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-224d1d75-6728-4996-907f-0421f133e61d tempest-GroupSnapshotsV319Test-1187230662 None] Delete group completed successfully. Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:31 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:41:31 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:32 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.775s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:41:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:41:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 8 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:41:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:41:37 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=34,cinder:UPDATE=31,cinder:DELETE=1,cinder:INSERT=8 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:41:38 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=31,cinder:UPDATE=37,cinder:INSERT=8,cinder:DELETE=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:41:42 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:41:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Flow 'volume_create_manager' (c81894fa-c0d1-4b69-9e89-dedde2c8fcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2c1d4d-f8b6-4f8a-ae97-8c8f71a5225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2c1d4d-f8b6-4f8a-ae97-8c8f71a5225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-168249157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8721a28-d22f-4cfa-91f1-8c09ae4ce405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2ac9cdaa6a4a87b6c700c1b64da97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:43Z,use_quota=True,user_id='832ac04bd138439e88601a8d89ad6e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a68ddba-5e02-4e16-b799-ca339d4943f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a68ddba-5e02-4e16-b799-ca339d4943f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043fe541-935e-490f-a53f-02a0618f5c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043fe541-935e-490f-a53f-02a0618f5c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8721a28-d22f-4cfa-91f1-8c09ae4ce405', 'volume_name': 'volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dbc1ca-ddfe-4188-a25c-b6109258624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dbc1ca-ddfe-4188-a25c-b6109258624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f1e996-02f3-44ab-a680-0102d57009c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:43 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Volume c8721a28-d22f-4cfa-91f1-8c09ae4ce405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405', 'volume_size': 1} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-168249157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8721a28-d22f-4cfa-91f1-8c09ae4ce405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2ac9cdaa6a4a87b6c700c1b64da97d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:43Z,use_quota=True,user_id='832ac04bd138439e88601a8d89ad6e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Creating volume c8721a28-d22f-4cfa-91f1-8c09ae4ce405 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:41:43 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:41:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:43 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 1073741824 Jun 12 04:41:43 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6e5e7e07-6a39-48a0-ad32-5b61c21fb9bf tempest-GroupsV320Test-1137540417 None] Group tempest-GroupsV320Test-Group-205110815: creating Jun 12 04:41:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6e5e7e07-6a39-48a0-ad32-5b61c21fb9bf tempest-GroupsV320Test-1137540417 None] Group tempest-GroupsV320Test-Group-205110815: created successfully Jun 12 04:41:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6e5e7e07-6a39-48a0-ad32-5b61c21fb9bf tempest-GroupsV320Test-1137540417 None] Create group completed successfully. Jun 12 04:41:44 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 1073741824" returned: 0 in 1.062s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:44 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 Jun 12 04:41:44 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:44 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" returned: 0 in 0.769s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f1e996-02f3-44ab-a680-0102d57009c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8731f60e-987a-4061-8f32-7d909a0d0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:45 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Volume volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 (c8721a28-d22f-4cfa-91f1-8c09ae4ce405): created successfully Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8731f60e-987a-4061-8f32-7d909a0d0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Flow 'volume_create_manager' (c81894fa-c0d1-4b69-9e89-dedde2c8fcae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-10aaa353-e9cc-466f-b7a4-5a6071178198 tempest-ServerActionsTestOtherA-1280537436 None] Created volume successfully. Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Created reservations ['7bd2afe4-6bb7-46b1-8efc-75ab51aea947'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:45 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:41:45 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:46 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.783s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:46 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:41:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4eee7405-cd3d-4781-b130-cd2367c9e777 tempest-GroupsV320Test-1137540417 None] Delete group completed successfully. Jun 12 04:41:54 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Flow 'volume_create_manager' (b7f09e8f-8054-44e3-adbc-dfc5922d95af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5cc128-fcc2-4bb5-a113-31d4285d512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5cc128-fcc2-4bb5-a113-31d4285d512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-10354650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40eca64d-e56a-42cc-a9d2-104ff2149e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072ad694565645bc80cfed2d8fface7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:55Z,use_quota=True,user_id='92d92b83dc78470e80f3092467c6f271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca90f8f-e602-42f4-86a1-ee455f449766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca90f8f-e602-42f4-86a1-ee455f449766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6e3ee7-8860-4bc1-99c9-c9d2c5fcf629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6e3ee7-8860-4bc1-99c9-c9d2c5fcf629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40eca64d-e56a-42cc-a9d2-104ff2149e51', 'volume_name': 'volume-40eca64d-e56a-42cc-a9d2-104ff2149e51', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a710144-e07e-4e79-b5c4-10e718208fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a710144-e07e-4e79-b5c4-10e718208fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13232feb-eee5-480b-abc6-d3a136005b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Volume 40eca64d-e56a-42cc-a9d2-104ff2149e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40eca64d-e56a-42cc-a9d2-104ff2149e51', 'volume_size': 1} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-10354650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40eca64d-e56a-42cc-a9d2-104ff2149e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072ad694565645bc80cfed2d8fface7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:55Z,use_quota=True,user_id='92d92b83dc78470e80f3092467c6f271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Creating volume 40eca64d-e56a-42cc-a9d2-104ff2149e51 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:41:55 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:55 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 1073741824 Jun 12 04:41:55 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Flow 'volume_create_manager' (4c16aff0-98f7-46b8-956d-389d5fc81c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014b997d-f815-48de-b7ac-f0600caace13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014b997d-f815-48de-b7ac-f0600caace13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1763536288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94068eb7-d95a-4252-a81f-109484bfc3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3841ed92c434c34bb4a080d95a2e74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:55Z,use_quota=True,user_id='8bdab64b927542a38921d818b9741fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726cd70d-d8f6-4a16-a0d1-1fdaa4b30321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726cd70d-d8f6-4a16-a0d1-1fdaa4b30321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9cdf65-e7e0-4fb1-a4cf-c693f6ab120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9cdf65-e7e0-4fb1-a4cf-c693f6ab120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94068eb7-d95a-4252-a81f-109484bfc3d4', 'volume_name': 'volume-94068eb7-d95a-4252-a81f-109484bfc3d4', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f55575e-dbe6-4d31-9343-c485e797c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f55575e-dbe6-4d31-9343-c485e797c68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18271323-eec2-4263-8246-d5bfc9b4a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Volume 94068eb7-d95a-4252-a81f-109484bfc3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94068eb7-d95a-4252-a81f-109484bfc3d4', 'volume_size': 1} Jun 12 04:41:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:56 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 1073741824" returned: 0 in 1.015s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:56 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 Jun 12 04:41:56 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:56 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51" returned: 0 in 0.753s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1763536288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94068eb7-d95a-4252-a81f-109484bfc3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3841ed92c434c34bb4a080d95a2e74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:41:55Z,use_quota=True,user_id='8bdab64b927542a38921d818b9741fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Creating volume 94068eb7-d95a-4252-a81f-109484bfc3d4 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:41:57 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:57 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 1073741824 Jun 12 04:41:57 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13232feb-eee5-480b-abc6-d3a136005b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40eca64d-e56a-42cc-a9d2-104ff2149e51', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af261d02-f76b-48c4-a1c5-896d3eecb1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:57 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Volume volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 (40eca64d-e56a-42cc-a9d2-104ff2149e51): created successfully Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af261d02-f76b-48c4-a1c5-896d3eecb1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Flow 'volume_create_manager' (b7f09e8f-8054-44e3-adbc-dfc5922d95af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1da4a151-9773-4b4e-8065-cc6e25876b18 tempest-VolumesServicesTestJSON-1363198575 None] Created volume successfully. Jun 12 04:41:58 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 1073741824" returned: 0 in 1.017s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:58 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 Jun 12 04:41:58 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Acquiring lock "cinder-40eca64d-e56a-42cc-a9d2-104ff2149e51-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Lock "cinder-40eca64d-e56a-42cc-a9d2-104ff2149e51-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Acquiring lock "cinder-quobyte-40eca64d-e56a-42cc-a9d2-104ff2149e51" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Lock "cinder-quobyte-40eca64d-e56a-42cc-a9d2-104ff2149e51" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[69343dc2-a50f-4e4a-b0c5-84846a9dd009]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:58 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 Jun 12 04:41:58 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:41:58 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4" returned: 0 in 0.908s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:41:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:41:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18271323-eec2-4263-8246-d5bfc9b4a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94068eb7-d95a-4252-a81f-109484bfc3d4', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0881cae9-63b3-497c-a067-98f3477c1537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:41:59 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Volume volume-94068eb7-d95a-4252-a81f-109484bfc3d4 (94068eb7-d95a-4252-a81f-109484bfc3d4): created successfully Jun 12 04:41:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0881cae9-63b3-497c-a067-98f3477c1537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:41:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Flow 'volume_create_manager' (4c16aff0-98f7-46b8-956d-389d5fc81c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:41:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6848f13d-09df-4bac-92db-fa3e94aa3afe tempest-DeleteServersTestJSON-1367326354 None] Created volume successfully. Jun 12 04:41:59 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jun 12 04:41:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51" returned: 0 in 1.023s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:41:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:41:59 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51 Jun 12 04:41:59 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:00 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-40eca64d-e56a-42cc-a9d2-104ff2149e51" returned: 0 in 0.762s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Lock "cinder-quobyte-40eca64d-e56a-42cc-a9d2-104ff2149e51" released by "delete_volume" :: held 1.839s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Created reservations ['8d3d12b0-7e94-4c72-97c2-4a43f197172d', 'abe757a6-6ef4-4c8a-a455-d0636d339a75', 'e213e32a-8d44-43bb-864a-ba2f30dd852e', '25a94ce6-6861-4090-b285-6c4f069a3729'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:01 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:42:01 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:02 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.273s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:02 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:42:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Deleted volume successfully. Jun 12 04:42:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f1269197-17fe-49dc-9686-3c63972c7f7a tempest-VolumesServicesTestJSON-1363198575 None] Lock "cinder-40eca64d-e56a-42cc-a9d2-104ff2149e51-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:42:08 devstack cinder-volume[92320]: WARNING py.warnings [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 12 04:42:08 devstack cinder-volume[92320]: .first() Jun 12 04:42:08 devstack cinder-volume[92320]: Jun 12 04:42:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:08 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a8a929-04bb-4566-8357-de2b164e3a31]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:08 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 Jun 12 04:42:08 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:09 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4" returned: 0 in 1.368s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.421s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-94068eb7-d95a-4252-a81f-109484bfc3d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af13eae6-e30f-45e3-b04e-b46993910460', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:42:10 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-0e511dbc-afc6-4365-b9b8-310696519034 req-787dbc2c-8c8f-47f9-bc6d-44750bdf4b1d tempest-DeleteServersTestJSON-1367326354 None] attachment_update completed successfully. Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Flow 'volume_create_manager' (6e4da614-14d8-4063-a3d5-8cad7f5d9c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6847e1e-3aa1-4cd3-965d-95a10458845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6847e1e-3aa1-4cd3-965d-95a10458845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-614376472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d35ddc8-0c6b-4649-b9e2-ed9389b849f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528049028f9d4112a0b7dc2852cbcef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:42:13Z,use_quota=True,user_id='400dc5894e3a49b0bb58d01a53852f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fd4107a-f405-4008-b800-41c7df858cdf),volume_type_id=2fd4107a-f405-4008-b800-41c7df858cdf)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14d580b-5407-4771-b1c5-a6b2eda66bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14d580b-5407-4771-b1c5-a6b2eda66bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fa7bd5-489c-4fb0-bf18-9147d7ac3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fa7bd5-489c-4fb0-bf18-9147d7ac3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d35ddc8-0c6b-4649-b9e2-ed9389b849f5', 'volume_name': 'volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee05a75-7554-4aca-b757-bdbbdcf18a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee05a75-7554-4aca-b757-bdbbdcf18a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f302cc09-77de-40a6-84f7-16798f8f4f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Volume 1d35ddc8-0c6b-4649-b9e2-ed9389b849f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5', 'volume_size': 1} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-614376472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d35ddc8-0c6b-4649-b9e2-ed9389b849f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528049028f9d4112a0b7dc2852cbcef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:42:13Z,use_quota=True,user_id='400dc5894e3a49b0bb58d01a53852f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fd4107a-f405-4008-b800-41c7df858cdf),volume_type_id=2fd4107a-f405-4008-b800-41c7df858cdf)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Creating volume 1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:42:12 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:42:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:12 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 1073741824 Jun 12 04:42:12 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:13 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 1073741824" returned: 0 in 0.979s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:13 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 Jun 12 04:42:13 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:14 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5" returned: 0 in 0.843s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f302cc09-77de-40a6-84f7-16798f8f4f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b389f02-7392-4c44-95b5-0819a281e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:14 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Volume volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 (1d35ddc8-0c6b-4649-b9e2-ed9389b849f5): created successfully Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b389f02-7392-4c44-95b5-0819a281e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Flow 'volume_create_manager' (6e4da614-14d8-4063-a3d5-8cad7f5d9c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:42:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-09f70b95-0449-48c9-9513-5f3ffb1272fb tempest-VolumeTypesAccessTest-1209277634 None] Created volume successfully. Jun 12 04:42:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Acquiring lock "cinder-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:42:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Lock "cinder-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:42:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Acquiring lock "cinder-quobyte-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:42:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Lock "cinder-quobyte-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:42:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3292f276-f317-4ea1-bd2a-593a2c5afbc2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:15 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 Jun 12 04:42:15 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:16 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5" returned: 0 in 0.872s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:16 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5 Jun 12 04:42:16 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:17 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5" returned: 0 in 1.340s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Lock "cinder-quobyte-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5" released by "delete_volume" :: held 2.295s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:42:17 devstack cinder-volume[92320]: WARNING cinder.quota [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1781765285 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1781765285, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:42:17 devstack cinder-volume[92320]: WARNING cinder.quota [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1781765285 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1781765285, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Created reservations ['e9706cc8-793f-41ee-ab14-b0642a94b252', '8573dd31-3821-4109-b1a7-47f28f026b56', '789d6f68-8099-4599-960c-a2075a9405eb', 'e84d2a1a-3476-47d8-bdbd-52ed57b605f6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:17 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:42:17 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:18 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.081s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:18 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:42:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Deleted volume successfully. Jun 12 04:42:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4689a80-82df-4373-99be-cacb1aba4e46 tempest-VolumeTypesAccessTest-1209277634 None] Lock "cinder-1d35ddc8-0c6b-4649-b9e2-ed9389b849f5-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:42:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-56456114-439c-496d-87cd-425c572063c0 req-2a9f4302-7eb0-4625-ae8c-2197aa33d16d tempest-DeleteServersTestJSON-1367326354 None] Terminate volume connection completed successfully. Jun 12 04:42:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-56456114-439c-496d-87cd-425c572063c0 req-2a9f4302-7eb0-4625-ae8c-2197aa33d16d tempest-DeleteServersTestJSON-1367326354 None] Deleting attachment af13eae6-e30f-45e3-b04e-b46993910460. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:42:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Acquiring lock "cinder-94068eb7-d95a-4252-a81f-109484bfc3d4-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:42:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Lock "cinder-94068eb7-d95a-4252-a81f-109484bfc3d4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:42:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Acquiring lock "cinder-quobyte-94068eb7-d95a-4252-a81f-109484bfc3d4" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:42:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Lock "cinder-quobyte-94068eb7-d95a-4252-a81f-109484bfc3d4" acquired by "delete_volume" :: waited 0.035s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:42:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e95819-9d11-48c8-bc1e-436daa61ea0d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:24 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 Jun 12 04:42:24 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:25 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4" returned: 0 in 0.845s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:25 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4 Jun 12 04:42:25 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:25 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-94068eb7-d95a-4252-a81f-109484bfc3d4" returned: 0 in 0.635s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Lock "cinder-quobyte-94068eb7-d95a-4252-a81f-109484bfc3d4" released by "delete_volume" :: held 1.526s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Created reservations ['faac1836-c66b-41c9-832d-d70d905d46fa', 'ea193f80-9c4b-4435-b1a4-4e09d4b928ed', '842b38c8-b236-4924-ac7d-38af62e1868f', '6e244013-faad-4109-801a-e3a5292937ed'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:25 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:42:25 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:26 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.916s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:26 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:42:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Deleted volume successfully. Jun 12 04:42:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4737fb11-97a8-4a3b-a3d0-e9f653e5ea8d tempest-DeleteServersTestJSON-1367326354 None] Lock "cinder-94068eb7-d95a-4252-a81f-109484bfc3d4-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:31 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:42:31 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Flow 'volume_create_manager' (9ad37f36-7cf2-4d7d-8b46-403cfb4e4f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7de869-14d0-43c7-b695-4ee835156f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7de869-14d0-43c7-b695-4ee835156f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1560399570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becc1b73-01ae-415e-8336-fca7f9853d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d342a951e7f4303b1594836d265d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:42:32Z,use_quota=True,user_id='5605ea57eb444726b6417e6d5a842de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab9d6a4-ca08-4c6c-b82e-36822f214b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab9d6a4-ca08-4c6c-b82e-36822f214b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376df50f-5fb0-4fed-8518-2611b4c76e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376df50f-5fb0-4fed-8518-2611b4c76e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becc1b73-01ae-415e-8336-fca7f9853d72', 'volume_name': 'volume-becc1b73-01ae-415e-8336-fca7f9853d72', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0daf83f-caec-4f2b-94dc-3c30a1feb57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0daf83f-caec-4f2b-94dc-3c30a1feb57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3106952b-ea2e-4326-a50c-3f3b33ff352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Volume becc1b73-01ae-415e-8336-fca7f9853d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becc1b73-01ae-415e-8336-fca7f9853d72', 'volume_size': 1} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1560399570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becc1b73-01ae-415e-8336-fca7f9853d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d342a951e7f4303b1594836d265d20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:42:32Z,use_quota=True,user_id='5605ea57eb444726b6417e6d5a842de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Creating volume becc1b73-01ae-415e-8336-fca7f9853d72 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:42:32 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:32 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.928s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:42:32 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 1073741824 Jun 12 04:42:32 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:33 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 1073741824" returned: 0 in 0.858s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:33 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 Jun 12 04:42:33 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:34 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72" returned: 0 in 0.615s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3106952b-ea2e-4326-a50c-3f3b33ff352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becc1b73-01ae-415e-8336-fca7f9853d72', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8503c8-ba09-413f-9031-01bd4d10e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Volume volume-becc1b73-01ae-415e-8336-fca7f9853d72 (becc1b73-01ae-415e-8336-fca7f9853d72): created successfully Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8503c8-ba09-413f-9031-01bd4d10e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Flow 'volume_create_manager' (9ad37f36-7cf2-4d7d-8b46-403cfb4e4f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:42:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ab30a619-548e-41c1-82a7-939bf0880d8e tempest-TaggedAttachmentsTest-1652171067 None] Created volume successfully. Jun 12 04:42:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c405e6-288e-4039-a998-fbccd321c06e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:36 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 Jun 12 04:42:36 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:36 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" returned: 0 in 0.920s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6cf7f3f-ed8b-46e8-a602-fbf477fa15ca', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:42:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-0f25bf05-bbad-436f-a6a2-3543512f88c0 req-fac78861-350a-41a0-bf65-8ada0f063c43 tempest-ServerActionsTestOtherA-1280537436 None] attachment_update completed successfully. Jun 12 04:42:45 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=44,cinder:UPDATE=42,cinder:DELETE=6,cinder:INSERT=9 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:42:45 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=50,cinder:UPDATE=50,cinder:INSERT=9,cinder:DELETE=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:42:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-32981769-ba46-4d65-b022-f96a3822c59c tempest-ServerActionsTestOtherA-1280537436 None] Terminate volume connection completed successfully. Jun 12 04:42:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-32981769-ba46-4d65-b022-f96a3822c59c tempest-ServerActionsTestOtherA-1280537436 None] Deleting attachment e6cf7f3f-ed8b-46e8-a602-fbf477fa15ca. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Flow 'volume_create_manager' (15c0e1a5-0cd8-40e5-9002-274b0838ef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e39072-3c2f-49a6-9da0-7c58ab6ad9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e39072-3c2f-49a6-9da0-7c58ab6ad9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-276441609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bb27e2-5c19-43e0-9384-c8464fb81902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d816fd4b74c64e6a8d4e6637661b1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:42:48Z,use_quota=True,user_id='e0ebac3a85ee47158cee73ac8ca52ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89068463-1e3c-4d48-8a4d-fbe3344e52e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89068463-1e3c-4d48-8a4d-fbe3344e52e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0e3b6c-298f-442a-b93a-e9ff080f6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e92c9-606e-45c0-9669-089624b0782b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:48 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 Jun 12 04:42:48 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0e3b6c-298f-442a-b93a-e9ff080f6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21bb27e2-5c19-43e0-9384-c8464fb81902', 'volume_name': 'volume-21bb27e2-5c19-43e0-9384-c8464fb81902', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b91c90-15e8-4b85-9c27-854c4e22c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b91c90-15e8-4b85-9c27-854c4e22c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73e5b0d-ef52-4001-8072-859691d3977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:42:48 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Volume 21bb27e2-5c19-43e0-9384-c8464fb81902: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21bb27e2-5c19-43e0-9384-c8464fb81902', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 12 04:42:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Trying to clone 21bb27e2-5c19-43e0-9384-c8464fb81902 from image 23fce906-aa03-46a6-9408-5b9570e89c54 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 04:42:49 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 04:42:49 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Image download 20.69 MB at 20.69 MB/s Jun 12 04:42:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdb5281-078a-4fc6-822e-fadffedfa306]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:49 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" returned: 0 in 0.983s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.015s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:49 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD Jun 12 04:42:49 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c406530f-a3c9-4c54-a376-2fdc22167830', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:42:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-835bf4bf-1916-4cc3-8e83-91da33594117 req-3ed77fc6-26d0-4e68-80ab-0bbf69f8efdc tempest-ServerActionsTestOtherA-1280537436 None] attachment_update completed successfully. Jun 12 04:42:50 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 is fetched for user e0ebac3a85ee47158cee73ac8ca52ed8. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f722c-412a-478b-b138-35e79cfb7d66]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:50 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD Jun 12 04:42:50 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:50 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-276441609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bb27e2-5c19-43e0-9384-c8464fb81902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d816fd4b74c64e6a8d4e6637661b1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:42:48Z,use_quota=True,user_id='e0ebac3a85ee47158cee73ac8ca52ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Creating volume 21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:42:50 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:42:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:50 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 1073741824 Jun 12 04:42:50 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:51 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 1073741824" returned: 0 in 0.981s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:51 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:42:51 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:52 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 0 in 0.660s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:42:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:42:52 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Attempting download of 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume 21bb27e2-5c19-43e0-9384-c8464fb81902. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 04:42:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c906f-04d9-4d89-8016-e40ef6e439d6]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:52 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys Jun 12 04:42:52 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:53 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys" returned: 0 in 0.694s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:53 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys Jun 12 04:42:53 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:54 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys" returned: 1 in 1.283s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_3hac2jys' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:42:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d9978c-7e3f-4264-9d5c-beb4237b219a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:42:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:54 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD Jun 12 04:42:54 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:55 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:55 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] 23fce906-aa03-46a6-9408-5b9570e89c54 was qcow2, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 04:42:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:55 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:42:55 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:42:59 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jun 12 04:42:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 0 in 4.174s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:42:59 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_v16iv9xedevstack@QuobyteHD, size 112.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:42:59 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Converted 112.00 MB image at 26.82 MB/s Jun 12 04:42:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:42:59 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 1G Jun 12 04:42:59 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:01 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 1G" returned: 0 in 1.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:01 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee8e72-91f6-4516-a8e8-dabfb558a4fc]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:01 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:43:01 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:02 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 0 in 1.108s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:02 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:INSERT=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:43:02 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:43:02 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:43:02 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:04 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 1 in 1.707s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Downloaded image 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume 21bb27e2-5c19-43e0-9384-c8464fb81902 successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 for user e0ebac3a85ee47158cee73ac8ca52ed8 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Marking volume 21bb27e2-5c19-43e0-9384-c8464fb81902 as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Copying metadata from image 23fce906-aa03-46a6-9408-5b9570e89c54 to 21bb27e2-5c19-43e0-9384-c8464fb81902. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Creating volume glance metadata for volume 21bb27e2-5c19-43e0-9384-c8464fb81902 backed by image 23fce906-aa03-46a6-9408-5b9570e89c54 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73e5b0d-ef52-4001-8072-859691d3977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bb27e2-5c19-43e0-9384-c8464fb81902', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3c2b0d-443d-4b4e-b8c1-773423b6e428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Volume volume-21bb27e2-5c19-43e0-9384-c8464fb81902 (21bb27e2-5c19-43e0-9384-c8464fb81902): created successfully Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3c2b0d-443d-4b4e-b8c1-773423b6e428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Flow 'volume_create_manager' (15c0e1a5-0cd8-40e5-9002-274b0838ef98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:04 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b47797e2-57bc-4e81-b723-4831195f9671 tempest-VolumesImageMetadata-627076245 None] Created volume successfully. Jun 12 04:43:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Acquiring lock "cinder-21bb27e2-5c19-43e0-9384-c8464fb81902-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Lock "cinder-21bb27e2-5c19-43e0-9384-c8464fb81902-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Acquiring lock "cinder-quobyte-21bb27e2-5c19-43e0-9384-c8464fb81902" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Lock "cinder-quobyte-21bb27e2-5c19-43e0-9384-c8464fb81902" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:06 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0262304-034b-4d34-9c40-a124da15427d]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:06 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:43:06 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:06 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 0 in 0.842s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:07 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:43:07 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:07 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 1 in 0.729s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:43:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:07 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902 Jun 12 04:43:07 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:09 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21bb27e2-5c19-43e0-9384-c8464fb81902" returned: 0 in 1.536s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Lock "cinder-quobyte-21bb27e2-5c19-43e0-9384-c8464fb81902" released by "delete_volume" :: held 3.233s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Created reservations ['21938880-e9de-4565-9f8d-a6c55f21746b', 'd4367003-4e35-4e32-8937-899683e45de5', '8d8ee48f-77d3-4211-8dbd-6fcbadbb1987', '4589e5ac-68eb-4bd4-9bc0-0e4c1b7a6a77'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:09 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:43:09 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:10 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.874s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:10 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:43:10 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Deleted volume successfully. Jun 12 04:43:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-81b5079c-e4bb-446f-b8b5-64bdfa2bdb5b tempest-VolumesImageMetadata-627076245 None] Lock "cinder-21bb27e2-5c19-43e0-9384-c8464fb81902-delete_volume" released by "delete_volume" :: held 4.597s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:19 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=8,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:43:20 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=11,cinder:INSERT=8,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Flow 'volume_create_manager' (152bbe66-f497-412b-a7f5-01eb1eb7dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f158ccb-908c-4e97-a37a-6ce213b17a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f158ccb-908c-4e97-a37a-6ce213b17a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-747095394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1855e30-900b-437b-a8e7-5a6d1b947d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9bd3f6abda42ab9493349f2de1a1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:22Z,use_quota=True,user_id='6db6ab47c7d04d01992088aa74916dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94676deb-03ae-447e-9a87-a460fb2baa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94676deb-03ae-447e-9a87-a460fb2baa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dda0977-67f2-4b40-89ff-98d92c14821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dda0977-67f2-4b40-89ff-98d92c14821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1855e30-900b-437b-a8e7-5a6d1b947d4d', 'volume_name': 'volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4878b162-3946-4c54-a05c-24790c76182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4878b162-3946-4c54-a05c-24790c76182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899d4cd1-ac6b-41b3-9c11-ce61d6955df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Volume d1855e30-900b-437b-a8e7-5a6d1b947d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d', 'volume_size': 1} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-747095394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1855e30-900b-437b-a8e7-5a6d1b947d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9bd3f6abda42ab9493349f2de1a1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:22Z,use_quota=True,user_id='6db6ab47c7d04d01992088aa74916dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Creating volume d1855e30-900b-437b-a8e7-5a6d1b947d4d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:43:21 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:43:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:21 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d 1073741824 Jun 12 04:43:21 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:22 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d 1073741824" returned: 0 in 0.923s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:22 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d Jun 12 04:43:22 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:23 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d" returned: 0 in 1.065s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:43:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899d4cd1-ac6b-41b3-9c11-ce61d6955df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c54b493-b1ad-40b6-abf9-3ce301bb3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Volume volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d (d1855e30-900b-437b-a8e7-5a6d1b947d4d): created successfully Jun 12 04:43:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c54b493-b1ad-40b6-abf9-3ce301bb3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Flow 'volume_create_manager' (152bbe66-f497-412b-a7f5-01eb1eb7dce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0239229b-3eb3-4ae1-9c2b-9f22c0b2f734 tempest-VolumesTransfersV357Test-2300560 None] Created volume successfully. Jun 12 04:43:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8915eabe-f17a-4113-b71c-66a6e1ae2573 tempest-VolumesTransfersV357Test-1698562208 None] Transfer volume completed successfully. Jun 12 04:43:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Acquiring lock "cinder-d1855e30-900b-437b-a8e7-5a6d1b947d4d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-d1855e30-900b-437b-a8e7-5a6d1b947d4d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Acquiring lock "cinder-quobyte-d1855e30-900b-437b-a8e7-5a6d1b947d4d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-quobyte-d1855e30-900b-437b-a8e7-5a6d1b947d4d" acquired by "delete_volume" :: waited 0.034s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:27 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[441bfedd-9631-47e9-b690-ee3bdb8f9fe7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:27 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d Jun 12 04:43:27 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:28 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d" returned: 0 in 1.076s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:28 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:43:28 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d Jun 12 04:43:28 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Flow 'volume_create_manager' (928f0dc6-6c5e-4a78-b83c-4a866cf77e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd76f0a6-3c47-4eb2-b5e5-3b46cb93d913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd76f0a6-3c47-4eb2-b5e5-3b46cb93d913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1542097159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a632c8-59f9-44e5-8412-85c0012937b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d05734a54324e9588d22fd4edb0277a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:29Z,use_quota=True,user_id='b22a322b25684594ab277eb7bfe7338b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c37ca7-bc98-4f3a-b90d-14105e167283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c37ca7-bc98-4f3a-b90d-14105e167283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2508f94f-351e-4a09-9dc7-b3cdd60a1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2508f94f-351e-4a09-9dc7-b3cdd60a1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a632c8-59f9-44e5-8412-85c0012937b1', 'volume_name': 'volume-80a632c8-59f9-44e5-8412-85c0012937b1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bb2416-6348-4d7d-957c-6e1113b1af7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bb2416-6348-4d7d-957c-6e1113b1af7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96e3893-d960-4322-b7a1-c11d443f5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:29 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Volume 80a632c8-59f9-44e5-8412-85c0012937b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a632c8-59f9-44e5-8412-85c0012937b1', 'volume_size': 1} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1542097159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a632c8-59f9-44e5-8412-85c0012937b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d05734a54324e9588d22fd4edb0277a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:29Z,use_quota=True,user_id='b22a322b25684594ab277eb7bfe7338b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Creating volume 80a632c8-59f9-44e5-8412-85c0012937b1 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:43:29 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:29 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 1073741824 Jun 12 04:43:29 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-c3c37d3c-7fbb-4007-9b0c-841610f9abe1 req-2f9f398d-eba1-4bb5-8358-97807e681c06 tempest-ServerActionsTestOtherA-1280537436 None] Terminate volume connection completed successfully. Jun 12 04:43:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-c3c37d3c-7fbb-4007-9b0c-841610f9abe1 req-2f9f398d-eba1-4bb5-8358-97807e681c06 tempest-ServerActionsTestOtherA-1280537436 None] Deleting attachment c406530f-a3c9-4c54-a376-2fdc22167830. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:43:30 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d1855e30-900b-437b-a8e7-5a6d1b947d4d" returned: 0 in 1.342s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-quobyte-d1855e30-900b-437b-a8e7-5a6d1b947d4d" released by "delete_volume" :: held 2.529s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Created reservations ['66ef824b-973e-4307-80a0-d2bcaa8c87b1', '5cdfe6d9-01d9-4f4d-a17d-41e88a4ab10e', '815d8f06-3727-40e0-ad4e-a669cc8ba210', 'bd73172f-68dd-4427-b2b8-5c462b1b7971'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:30 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:43:30 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:31 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 1073741824" returned: 0 in 1.825s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:31 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 Jun 12 04:43:31 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:31 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.121s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:43:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Deleted volume successfully. Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6d9b8f5a-e920-4d87-a3e9-fab9bd4bf181 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-d1855e30-900b-437b-a8e7-5a6d1b947d4d-delete_volume" released by "delete_volume" :: held 4.194s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:31 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:43:31 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Flow 'volume_create_manager' (39e907c6-88bd-45cc-928f-d2cd84051a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c35388-b261-4844-94ac-3c0af396dbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c35388-b261-4844-94ac-3c0af396dbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1117762444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c687ed-708b-4d8f-9133-fc78499078f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9bd3f6abda42ab9493349f2de1a1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:32Z,use_quota=True,user_id='6db6ab47c7d04d01992088aa74916dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3108d1f3-721c-4484-94b0-57423652c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3108d1f3-721c-4484-94b0-57423652c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b72da28-0289-4ded-b47e-dd3aa3fae4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b72da28-0289-4ded-b47e-dd3aa3fae4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c687ed-708b-4d8f-9133-fc78499078f0', 'volume_name': 'volume-f9c687ed-708b-4d8f-9133-fc78499078f0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fc9bb8-e961-40ea-85a4-28684fe52bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fc9bb8-e961-40ea-85a4-28684fe52bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebb04b4-aa4a-41f6-afa6-18021feb1ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Volume f9c687ed-708b-4d8f-9133-fc78499078f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c687ed-708b-4d8f-9133-fc78499078f0', 'volume_size': 1} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:32 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1" returned: 0 in 1.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] <== create_volume: return (3715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.719s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1117762444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c687ed-708b-4d8f-9133-fc78499078f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9bd3f6abda42ab9493349f2de1a1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:32Z,use_quota=True,user_id='6db6ab47c7d04d01992088aa74916dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Creating volume f9c687ed-708b-4d8f-9133-fc78499078f0 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:43:32 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:43:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96e3893-d960-4322-b7a1-c11d443f5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a632c8-59f9-44e5-8412-85c0012937b1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:33 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 1073741824 Jun 12 04:43:33 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6159147f-d5ba-4827-825e-e41d84dba04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:33 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Volume volume-80a632c8-59f9-44e5-8412-85c0012937b1 (80a632c8-59f9-44e5-8412-85c0012937b1): created successfully Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6159147f-d5ba-4827-825e-e41d84dba04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Flow 'volume_create_manager' (928f0dc6-6c5e-4a78-b83c-4a866cf77e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:33 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d142689f-a40e-4d88-8a30-72ea5be86ce0 tempest-ServerRescueNegativeTestJSON-717828874 None] Created volume successfully. Jun 12 04:43:33 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:43:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:43:34 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 1073741824" returned: 0 in 1.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:34 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 Jun 12 04:43:34 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:35 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0" returned: 0 in 0.718s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebb04b4-aa4a-41f6-afa6-18021feb1ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c687ed-708b-4d8f-9133-fc78499078f0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f34e468-b1bf-4c8c-a6dd-a9d9ef26e51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Volume volume-f9c687ed-708b-4d8f-9133-fc78499078f0 (f9c687ed-708b-4d8f-9133-fc78499078f0): created successfully Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f34e468-b1bf-4c8c-a6dd-a9d9ef26e51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Flow 'volume_create_manager' (39e907c6-88bd-45cc-928f-d2cd84051a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:35 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0853b672-c012-45a6-bd7b-74737e7b54b7 tempest-VolumesTransfersV357Test-2300560 None] Created volume successfully. Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Acquiring lock "cinder-f9c687ed-708b-4d8f-9133-fc78499078f0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-f9c687ed-708b-4d8f-9133-fc78499078f0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Acquiring lock "cinder-quobyte-f9c687ed-708b-4d8f-9133-fc78499078f0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-quobyte-f9c687ed-708b-4d8f-9133-fc78499078f0" acquired by "delete_volume" :: waited 0.043s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1772d8-b856-44da-b3e4-e2864c0a5a52]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:36 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 Jun 12 04:43:36 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de02d06-803e-4c85-a0e4-2e2bc945a5b3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:37 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 Jun 12 04:43:37 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:37 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0" returned: 0 in 0.991s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:37 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0 Jun 12 04:43:37 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:37 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72" returned: 0 in 0.801s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.825s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-becc1b73-01ae-415e-8336-fca7f9853d72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3f8f1e0-7cbb-4bbb-b0f8-c04d9c345dd9', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:43:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-8dd2fe54-3125-43b8-a0bd-e2d5b5184abe req-f98f0576-26f3-4421-b700-a1551fbf1508 tempest-TaggedAttachmentsTest-1652171067 None] attachment_update completed successfully. Jun 12 04:43:38 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f9c687ed-708b-4d8f-9133-fc78499078f0" returned: 0 in 0.870s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-quobyte-f9c687ed-708b-4d8f-9133-fc78499078f0" released by "delete_volume" :: held 1.919s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Created reservations ['2cc8dd2f-094c-4fd6-bebf-023f148b16b0', '80501ae5-c2d1-444b-8d8f-dfa70609577a', '6e62596f-a365-40d4-b939-ba624c2d58d4', '6b4b9faa-1f32-42d5-ae5b-750ccab9a0c4'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:38 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:43:38 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:39 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.999s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:39 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:43:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Deleted volume successfully. Jun 12 04:43:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b73ead93-ad89-4fac-86d4-c27adb45cc45 tempest-VolumesTransfersV357Test-711559881 None] Lock "cinder-f9c687ed-708b-4d8f-9133-fc78499078f0-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "cinder-c8721a28-d22f-4cfa-91f1-8c09ae4ce405-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Lock "cinder-c8721a28-d22f-4cfa-91f1-8c09ae4ce405-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "cinder-quobyte-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Lock "cinder-quobyte-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:41 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1471a70-8ad7-4e1c-bef6-79844eb67809]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:41 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 Jun 12 04:43:41 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:42 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" returned: 0 in 0.834s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:42 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405 Jun 12 04:43:42 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:43 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" returned: 0 in 0.643s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Lock "cinder-quobyte-c8721a28-d22f-4cfa-91f1-8c09ae4ce405" released by "delete_volume" :: held 1.523s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Created reservations ['1f1eb5f7-9f91-4640-a280-e11ae39af67c', '42c932bc-00a7-43ab-85a7-ee4353be3e94', 'b002dd4b-86c8-44fc-ad0e-fedd4e7709e0', '69dcb7eb-eb6c-48a5-8c26-6064747c24ce'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:43 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:43:43 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:44 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.715s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:44 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:43:44 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Deleted volume successfully. Jun 12 04:43:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09df0a46-8885-47dd-9e91-37968637754a tempest-ServerActionsTestOtherA-1280537436 None] Lock "cinder-c8721a28-d22f-4cfa-91f1-8c09ae4ce405-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-8e2157fd-8d71-4df1-994b-a2df6b6261ec req-f6690d28-0c3f-4182-9c01-0bf4228a64ab tempest-TaggedAttachmentsTest-1652171067 None] Terminate volume connection completed successfully. Jun 12 04:43:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-8e2157fd-8d71-4df1-994b-a2df6b6261ec req-f6690d28-0c3f-4182-9c01-0bf4228a64ab tempest-TaggedAttachmentsTest-1652171067 None] Deleting attachment f3f8f1e0-7cbb-4bbb-b0f8-c04d9c345dd9. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Flow 'volume_create_manager' (feb5cea6-83b2-4485-a6de-26d1202b72c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10ffe58-9698-4a1b-8037-fe623aaa9be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10ffe58-9698-4a1b-8037-fe623aaa9be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1519369742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f5ce8-037c-42c6-9d8a-54e42c45912a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9f652bc9364617af035cf01c9bad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:46Z,use_quota=True,user_id='b268d8df672a40b6b835c2fcc939fdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9769ca8e-96c4-468d-9969-bd1a9b23b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9769ca8e-96c4-468d-9969-bd1a9b23b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45c7ac9-387f-4cfb-af41-290abb52dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45c7ac9-387f-4cfb-af41-290abb52dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'volume_name': 'volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475afaea-2140-4e90-b1fa-7866cae060d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475afaea-2140-4e90-b1fa-7866cae060d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddbe3fa-10c8-46e6-9aae-986e6a222c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:46 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Volume b82f5ce8-037c-42c6-9d8a-54e42c45912a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'volume_size': 1} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1519369742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82f5ce8-037c-42c6-9d8a-54e42c45912a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9f652bc9364617af035cf01c9bad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:46Z,use_quota=True,user_id='b268d8df672a40b6b835c2fcc939fdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Creating volume b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:43:46 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:43:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:46 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a 1073741824 Jun 12 04:43:46 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:48 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a 1073741824" returned: 0 in 1.866s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:48 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:43:48 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:49 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 1.241s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] <== create_volume: return (3193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.195s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddbe3fa-10c8-46e6-9aae-986e6a222c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15c1d22-3c7c-4355-83b0-9a7656772960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:49 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Volume volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a (b82f5ce8-037c-42c6-9d8a-54e42c45912a): created successfully Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15c1d22-3c7c-4355-83b0-9a7656772960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Flow 'volume_create_manager' (feb5cea6-83b2-4485-a6de-26d1202b72c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-759d5a27-a87d-4a57-8a9c-896052c668ce tempest-VolumesCloneTest-2124153963 None] Created volume successfully. Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Flow 'volume_create_manager' (d2e0e36a-b62e-4db3-95c4-ac374e77c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f9194-0f56-44ee-8b04-81064d7e8945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f9194-0f56-44ee-8b04-81064d7e8945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-919995163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a404a934-1fb2-468e-ae2c-4fe28451d3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9f652bc9364617af035cf01c9bad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:43:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b82f5ce8-037c-42c6-9d8a-54e42c45912a,status='creating',terminated_at=None,updated_at=2026-06-12T02:43:50Z,use_quota=True,user_id='b268d8df672a40b6b835c2fcc939fdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c832637-4ea4-4a94-b23c-d54286600f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c832637-4ea4-4a94-b23c-d54286600f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7e0711-e321-417c-a2ba-c24c27e7b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7e0711-e321-417c-a2ba-c24c27e7b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a404a934-1fb2-468e-ae2c-4fe28451d3a0', 'volume_name': 'volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0', 'volume_size': 2, 'source_volid': 'b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'source_volstatus': 'available'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da9eb62-32d2-4de3-83c6-1e2f521155be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da9eb62-32d2-4de3-83c6-1e2f521155be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b0a9e8-2078-4ccc-9141-6bd98aac86ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:43:50 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Volume a404a934-1fb2-468e-ae2c-4fe28451d3a0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0', 'volume_size': 2, 'source_volid': 'b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'source_volstatus': 'available'} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:50 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Cloning volume b82f5ce8-037c-42c6-9d8a-54e42c45912a to volume a404a934-1fb2-468e-ae2c-4fe28451d3a0 Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Creating offline snapshot f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a of volume b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102b56d-914a-484b-b50c-1aef60ac31fc]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:50 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:43:50 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:51 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 0.842s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:51 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a 1G Jun 12 04:43:51 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:52 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a 1G" returned: 0 in 1.269s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:52 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a Jun 12 04:43:52 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:53 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" returned: 0 in 0.921s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:53 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a is being set with open permissions: ugo+rw Jun 12 04:43:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:53 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a Jun 12 04:43:53 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Acquiring lock "cinder-80a632c8-59f9-44e5-8412-85c0012937b1-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "cinder-80a632c8-59f9-44e5-8412-85c0012937b1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Acquiring lock "cinder-quobyte-80a632c8-59f9-44e5-8412-85c0012937b1" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "cinder-quobyte-80a632c8-59f9-44e5-8412-85c0012937b1" acquired by "delete_volume" :: waited 0.056s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4228bb6c-05d7-48bd-afd3-529d622ea7fa]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:54 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 Jun 12 04:43:54 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:54 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" returned: 0 in 0.826s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:54 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info Jun 12 04:43:54 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:55 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1" returned: 0 in 0.948s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:55 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1 Jun 12 04:43:55 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:55 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info" returned: 0 in 1.033s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:55 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info is being set with open permissions: ugo+rw Jun 12 04:43:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:55 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info Jun 12 04:43:55 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:56 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-80a632c8-59f9-44e5-8412-85c0012937b1" returned: 0 in 1.225s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "cinder-quobyte-80a632c8-59f9-44e5-8412-85c0012937b1" released by "delete_volume" :: held 2.280s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Created reservations ['4d2b1550-95f3-40c5-a4f6-98263ce9a9d8', '864046d2-f682-4431-a6f5-bc372f0e5d0d', 'c98e0bca-1494-4684-8a23-6ebedcd3d4a3', '84ee2a3e-6496-4773-88ef-4c17192b9fd2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:56 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.info" returned: 0 in 1.146s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:56 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:43:56 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "cinder-quobyte-a404a934-1fb2-468e-ae2c-4fe28451d3a0" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-a404a934-1fb2-468e-ae2c-4fe28451d3a0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] snapshot: f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a, volume: a404a934-1fb2-468e-ae2c-4fe28451d3a0, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7211bb-7cd0-4249-937c-b2559f8b7ef2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:57 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a Jun 12 04:43:57 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:58 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.489s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:43:58 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Deleted volume successfully. Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4115757a-37a7-46d5-8aa0-0883b7d10d3e tempest-ServerRescueNegativeTestJSON-717828874 None] Lock "cinder-80a632c8-59f9-44e5-8412-85c0012937b1-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:43:58 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" returned: 0 in 1.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2418aff-8fc9-4112-b6da-a9d2b72eff32]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:43:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:58 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:43:58 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:43:59 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jun 12 04:43:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 1.329s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:43:59 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 04:43:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:43:59 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 Jun 12 04:43:59 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:08 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0" returned: 0 in 8.328s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:08 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ac3c4-1e6a-49e4-bb30-b1e03b9b422a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:44:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:08 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=43,cinder:INSERT=11,cinder:UPDATE=46,cinder:DELETE=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:44:08 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:44:08 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:09 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 1.120s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:09 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a, size 1024.00 MB, duration 8.33 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:44:09 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Converted 1024.00 MB image at 122.94 MB/s Jun 12 04:44:09 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 is being set with open permissions: ugo+rw Jun 12 04:44:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:09 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 Jun 12 04:44:09 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Acquiring lock "cinder-becc1b73-01ae-415e-8336-fca7f9853d72-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Lock "cinder-becc1b73-01ae-415e-8336-fca7f9853d72-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Acquiring lock "cinder-quobyte-becc1b73-01ae-415e-8336-fca7f9853d72" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Lock "cinder-quobyte-becc1b73-01ae-415e-8336-fca7f9853d72" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b897cb-b546-40c1-a0f3-251e60915e31]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:10 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0" returned: 0 in 1.037s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-a404a934-1fb2-468e-ae2c-4fe28451d3a0" released by "_copy_volume_from_snapshot" :: held 13.617s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "cinder-quobyte-f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:10 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 Jun 12 04:44:10 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Deleting offline snapshot f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a of volume b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] snapshot_file for this snap is: volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb451b8e-4cee-4c83-a3a2-441d30cbe631]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:44:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:10 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a Jun 12 04:44:10 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:11 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72" returned: 0 in 0.970s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:11 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72 Jun 12 04:44:11 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:11 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" returned: 0 in 0.979s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a678c-3272-4c3f-9d46-ef106473515c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:11 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:44:11 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:11 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-becc1b73-01ae-415e-8336-fca7f9853d72" returned: 0 in 0.745s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Lock "cinder-quobyte-becc1b73-01ae-415e-8336-fca7f9853d72" released by "delete_volume" :: held 1.774s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Created reservations ['f00cf6fe-da83-4d9a-ac2a-5646765f7cbd', 'c21d1dd1-3df1-4e3d-9fe0-08fc38f804c4', '1a6430b6-52ce-4b8c-b684-8e3b7f9ac7f6', 'f51ab21c-b417-48b5-a45f-23f4b45b18ae'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:12 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:44:12 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:12 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 0.819s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:12 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a Jun 12 04:44:12 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:12 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:44:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Deleted volume successfully. Jun 12 04:44:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3c502f48-5eaa-4b85-855c-3ac0db6fa951 tempest-TaggedAttachmentsTest-1652171067 None] Lock "cinder-becc1b73-01ae-415e-8336-fca7f9853d72-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:13 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" returned: 0 in 0.934s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:13 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a Jun 12 04:44:13 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:13 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a.f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" returned: 0 in 0.640s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-f54c1fcf-e0af-4d56-b4f3-8595d4e0cb6a" released by "_delete_snapshot" :: held 3.481s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.409s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b0a9e8-2078-4ccc-9141-6bd98aac86ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0', 'volume_size': 2, 'source_volid': 'b82f5ce8-037c-42c6-9d8a-54e42c45912a', 'source_volstatus': 'available'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2b1386-f8be-413a-ba01-2d287e5ddc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:14 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Volume volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 (a404a934-1fb2-468e-ae2c-4fe28451d3a0): created successfully Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2b1386-f8be-413a-ba01-2d287e5ddc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Flow 'volume_create_manager' (d2e0e36a-b62e-4db3-95c4-ac374e77c727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:44:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a027b09c-bfa8-46d7-becb-1030c94c0f08 tempest-VolumesCloneTest-2124153963 None] Created volume successfully. Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Acquiring lock "cinder-a404a934-1fb2-468e-ae2c-4fe28451d3a0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Lock "cinder-a404a934-1fb2-468e-ae2c-4fe28451d3a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Acquiring lock "cinder-quobyte-a404a934-1fb2-468e-ae2c-4fe28451d3a0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-a404a934-1fb2-468e-ae2c-4fe28451d3a0" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0862881-02c6-4db3-97e7-25288387f9a2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:44:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:14 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 Jun 12 04:44:14 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:15 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0" returned: 0 in 0.767s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:15 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0 Jun 12 04:44:15 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:15 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a404a934-1fb2-468e-ae2c-4fe28451d3a0" returned: 0 in 0.654s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-a404a934-1fb2-468e-ae2c-4fe28451d3a0" released by "delete_volume" :: held 1.483s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Created reservations ['ed3a00ee-1b48-45e3-a5b2-7e862248717e', 'a6c91b59-3ada-4b6a-8f69-9a2a2f3a947b', 'a52c2847-da75-4c03-84b4-998e6de38cf5', 'bf654b70-098a-455a-a33a-5a32bbf2be76'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:16 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:44:16 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "cinder-b82f5ce8-037c-42c6-9d8a-54e42c45912a-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-b82f5ce8-037c-42c6-9d8a-54e42c45912a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "cinder-quobyte-b82f5ce8-037c-42c6-9d8a-54e42c45912a" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:44:16 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.753s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-b82f5ce8-037c-42c6-9d8a-54e42c45912a" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:44:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Deleted volume successfully. Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3138dbf2-7eae-4871-bda5-6fe1c72cbe6c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dd9a2266-7bb9-43d9-90a3-3736d071641b tempest-VolumesCloneTest-2124153963 None] Lock "cinder-a404a934-1fb2-468e-ae2c-4fe28451d3a0-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:17 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:44:17 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:17 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 0.933s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:17 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a Jun 12 04:44:17 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:18 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b82f5ce8-037c-42c6-9d8a-54e42c45912a" returned: 0 in 0.631s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-quobyte-b82f5ce8-037c-42c6-9d8a-54e42c45912a" released by "delete_volume" :: held 1.656s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Created reservations ['ccffed83-67cb-4317-93a1-7b95094ed0f5', '43fc6340-f573-47ce-abd1-c74a8876c799', 'a5b61695-08ca-4bd5-b56c-cdf3eafd31b2', 'afde5bf2-8ad5-4544-993c-45cb9b6feedc'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:18 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:44:18 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:19 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:19 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:44:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Deleted volume successfully. Jun 12 04:44:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7d515465-38f7-4513-8971-3033005839f0 tempest-VolumesCloneTest-2124153963 None] Lock "cinder-b82f5ce8-037c-42c6-9d8a-54e42c45912a-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:44:28 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=27,cinder:SELECT=15,cinder:INSERT=7 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:44:29 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=76,cinder:SELECT=57,cinder:INSERT=17,cinder:DELETE=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:31 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:44:31 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:32 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:44:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:44:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:44:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Flow 'volume_create_manager' (922c0ef2-f7e2-4c95-b532-ddb54d7e3703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb26073-bb69-4b7b-b21d-309812236915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb26073-bb69-4b7b-b21d-309812236915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-522121358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1927e7a9-cfdd-47aa-b95f-ba7335e511e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7b69ae6d2d4ccfa3e257902d828e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:44:54Z,use_quota=True,user_id='0bd56fddf7bf4ef5b00b09daa7e314ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106562dd-0659-45aa-b408-ac30bc2c13d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106562dd-0659-45aa-b408-ac30bc2c13d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdaf4f9-5509-4e39-b060-8f4ca8add48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdaf4f9-5509-4e39-b060-8f4ca8add48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1927e7a9-cfdd-47aa-b95f-ba7335e511e0', 'volume_name': 'volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e23ea-422a-4c05-ba71-adc43adc666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e23ea-422a-4c05-ba71-adc43adc666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c149733-cec2-4a12-a4a0-8ecb37faebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Volume 1927e7a9-cfdd-47aa-b95f-ba7335e511e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0', 'volume_size': 1} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-522121358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1927e7a9-cfdd-47aa-b95f-ba7335e511e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7b69ae6d2d4ccfa3e257902d828e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:44:54Z,use_quota=True,user_id='0bd56fddf7bf4ef5b00b09daa7e314ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Creating volume 1927e7a9-cfdd-47aa-b95f-ba7335e511e0 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:44:54 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:54 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 1073741824 Jun 12 04:44:54 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Flow 'volume_create_manager' (bd4df598-b6a0-438d-ab20-f46053e2f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d5f3c7-95ad-47f8-afec-3153d63b5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d5f3c7-95ad-47f8-afec-3153d63b5143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-513408513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32ee205-d894-48c3-b20b-5d784d035492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7b69ae6d2d4ccfa3e257902d828e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:44:54Z,use_quota=True,user_id='0bd56fddf7bf4ef5b00b09daa7e314ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb24b98b-88e2-4774-9851-a6b74eda4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb24b98b-88e2-4774-9851-a6b74eda4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cf8830-8840-43fb-a1b9-81cc58141601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cf8830-8840-43fb-a1b9-81cc58141601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32ee205-d894-48c3-b20b-5d784d035492', 'volume_name': 'volume-c32ee205-d894-48c3-b20b-5d784d035492', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ec63f6-bd59-4c7a-9343-003103c60370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ec63f6-bd59-4c7a-9343-003103c60370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9ae7d4-35b4-4a2c-bff0-a47c5eff7c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:54 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Volume c32ee205-d894-48c3-b20b-5d784d035492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32ee205-d894-48c3-b20b-5d784d035492', 'volume_size': 1} Jun 12 04:44:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:55 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 1073741824" returned: 0 in 1.062s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:55 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 Jun 12 04:44:55 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:56 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-513408513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32ee205-d894-48c3-b20b-5d784d035492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7b69ae6d2d4ccfa3e257902d828e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:44:54Z,use_quota=True,user_id='0bd56fddf7bf4ef5b00b09daa7e314ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Creating volume c32ee205-d894-48c3-b20b-5d784d035492 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:44:56 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c149733-cec2-4a12-a4a0-8ecb37faebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:56 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 1073741824 Jun 12 04:44:56 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fc8117-4338-41db-9a57-3189b084fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Volume volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 (1927e7a9-cfdd-47aa-b95f-ba7335e511e0): created successfully Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fc8117-4338-41db-9a57-3189b084fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Flow 'volume_create_manager' (922c0ef2-f7e2-4c95-b532-ddb54d7e3703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:44:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0243795e-d345-433a-8678-d50961eafe63 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Created volume successfully. Jun 12 04:44:57 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 1073741824" returned: 0 in 1.067s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:44:57 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 Jun 12 04:44:57 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:44:57 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492" returned: 0 in 0.657s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9ae7d4-35b4-4a2c-bff0-a47c5eff7c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32ee205-d894-48c3-b20b-5d784d035492', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c40326a-3b07-407f-8c71-1b70b022c073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:44:57 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Volume volume-c32ee205-d894-48c3-b20b-5d784d035492 (c32ee205-d894-48c3-b20b-5d784d035492): created successfully Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c40326a-3b07-407f-8c71-1b70b022c073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:44:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Flow 'volume_create_manager' (bd4df598-b6a0-438d-ab20-f46053e2f415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:44:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9d28ccb6-838b-4417-9642-f8966ad7fca4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Created volume successfully. Jun 12 04:45:07 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:45:07 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:31 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:45:31 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:32 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.843s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:45:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:45:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:45:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:45:33 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:45:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Flow 'volume_create_manager' (3b62937f-405f-42d9-96aa-fcf28df1116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e01c55b-c9d0-49e5-a775-7af0a46d805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e01c55b-c9d0-49e5-a775-7af0a46d805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-451270954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fde58f0-3af7-440f-8bea-c206f9302ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb88db0f23741b59b381b3573707cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:34Z,use_quota=True,user_id='88c89bcb129641e8977574c702dcbb03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f4844f-ec94-4bc7-9b4a-09beb7d17e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f4844f-ec94-4bc7-9b4a-09beb7d17e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1063f861-c5d1-4308-85c8-72fde42a9b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1063f861-c5d1-4308-85c8-72fde42a9b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fde58f0-3af7-440f-8bea-c206f9302ae5', 'volume_name': 'volume-6fde58f0-3af7-440f-8bea-c206f9302ae5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8493685a-e604-479d-a54c-57bee7bc61ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8493685a-e604-479d-a54c-57bee7bc61ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000a5334-3b82-4d86-98c4-5bd755c3c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Volume 6fde58f0-3af7-440f-8bea-c206f9302ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fde58f0-3af7-440f-8bea-c206f9302ae5', 'volume_size': 1} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-451270954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fde58f0-3af7-440f-8bea-c206f9302ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb88db0f23741b59b381b3573707cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:34Z,use_quota=True,user_id='88c89bcb129641e8977574c702dcbb03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Creating volume 6fde58f0-3af7-440f-8bea-c206f9302ae5 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:45:34 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:34 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 1073741824 Jun 12 04:45:34 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:34 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 1073741824" returned: 0 in 0.831s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:34 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 Jun 12 04:45:34 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:35 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5" returned: 0 in 0.589s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000a5334-3b82-4d86-98c4-5bd755c3c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fde58f0-3af7-440f-8bea-c206f9302ae5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f548c5a8-056d-4e59-ae88-5961805cfa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Volume volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 (6fde58f0-3af7-440f-8bea-c206f9302ae5): created successfully Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f548c5a8-056d-4e59-ae88-5961805cfa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Flow 'volume_create_manager' (3b62937f-405f-42d9-96aa-fcf28df1116c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:35 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6923313a-8cba-41ee-b147-14e2e8c98fa3 tempest-AttachVolumeTestJSON-732787644 None] Created volume successfully. Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Flow 'volume_create_manager' (428895d8-a34a-402e-b1f9-11f91e1c1a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d876b816-31ee-4d29-b911-3d0277a845ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d876b816-31ee-4d29-b911-3d0277a845ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1374646038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f029c8-5108-4669-b260-e7125f27c284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f14660e3c9f4eeb95676a17ed39eb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:37Z,use_quota=True,user_id='4d7dec7a8c374d55814e801f0cea8a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbedf271-7e06-409b-96f2-77a6ef907be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbedf271-7e06-409b-96f2-77a6ef907be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa962c2-a6e3-4acb-aff7-1ca50f0b1ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa962c2-a6e3-4acb-aff7-1ca50f0b1ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f029c8-5108-4669-b260-e7125f27c284', 'volume_name': 'volume-e0f029c8-5108-4669-b260-e7125f27c284', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d622d4d7-5ae3-463d-a29b-e0f84f3150cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d622d4d7-5ae3-463d-a29b-e0f84f3150cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002d0cf9-254a-4da1-bd67-8a150a664645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:37 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Volume e0f029c8-5108-4669-b260-e7125f27c284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f029c8-5108-4669-b260-e7125f27c284', 'volume_size': 1} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1374646038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f029c8-5108-4669-b260-e7125f27c284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f14660e3c9f4eeb95676a17ed39eb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:37Z,use_quota=True,user_id='4d7dec7a8c374d55814e801f0cea8a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Creating volume e0f029c8-5108-4669-b260-e7125f27c284 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:45:37 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:37 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 1073741824 Jun 12 04:45:37 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:37 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 1073741824" returned: 0 in 0.736s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:37 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 Jun 12 04:45:37 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:38 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284" returned: 0 in 0.618s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002d0cf9-254a-4da1-bd67-8a150a664645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f029c8-5108-4669-b260-e7125f27c284', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff0c0fa-29d2-4882-b508-3aa68c561d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Volume volume-e0f029c8-5108-4669-b260-e7125f27c284 (e0f029c8-5108-4669-b260-e7125f27c284): created successfully Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff0c0fa-29d2-4882-b508-3aa68c561d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Flow 'volume_create_manager' (428895d8-a34a-402e-b1f9-11f91e1c1a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b96e1f92-3df6-4d92-8f47-c2594946f3f6 tempest-ServersNegativeTestJSON-1482150258 None] Created volume successfully. Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71bb45-f968-44ca-b75f-b9d3f4adeb0e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:39 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 Jun 12 04:45:39 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:39 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5" returned: 0 in 0.778s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-6fde58f0-3af7-440f-8bea-c206f9302ae5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cc24836-3c1f-43c1-bf69-db0dd82da39d', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:45:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-3e5f3b10-7493-46b8-9725-61bdf5619198 req-18a4cab2-4f64-4f91-98a0-ae0ef579bff3 tempest-AttachVolumeTestJSON-732787644 None] attachment_update completed successfully. Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Flow 'volume_create_manager' (f1efeb41-aa02-454b-bcaf-ab8edfad99be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca919b5-390a-4b70-b2b7-baba84f6411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca919b5-390a-4b70-b2b7-baba84f6411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1899160732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a052636-3519-4e0b-9810-4c0a975fb021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f14660e3c9f4eeb95676a17ed39eb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:40Z,use_quota=True,user_id='4d7dec7a8c374d55814e801f0cea8a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c83860-527e-43a5-a603-3aaa14346de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c83860-527e-43a5-a603-3aaa14346de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e57626e-26f9-40b2-a225-6ac655c16b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e57626e-26f9-40b2-a225-6ac655c16b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a052636-3519-4e0b-9810-4c0a975fb021', 'volume_name': 'volume-2a052636-3519-4e0b-9810-4c0a975fb021', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc4533e-b353-4d04-b1e5-659e0344324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc4533e-b353-4d04-b1e5-659e0344324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ad5ace-b8f5-48c4-b423-14dc7bb9aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Volume 2a052636-3519-4e0b-9810-4c0a975fb021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a052636-3519-4e0b-9810-4c0a975fb021', 'volume_size': 1} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1899160732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a052636-3519-4e0b-9810-4c0a975fb021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f14660e3c9f4eeb95676a17ed39eb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:40Z,use_quota=True,user_id='4d7dec7a8c374d55814e801f0cea8a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Creating volume 2a052636-3519-4e0b-9810-4c0a975fb021 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:45:40 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:45:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:40 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 1073741824 Jun 12 04:45:40 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Flow 'volume_create_manager' (9cee3761-ab12-496d-af82-66bf7c8a764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0a863a-f1fc-4cab-9114-d4067d6f86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0a863a-f1fc-4cab-9114-d4067d6f86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1942676667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425ad7a8-1c3d-4558-8c6b-1a86af5b60e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f4a8835f82427a90b37fbf7d18b2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:41Z,use_quota=True,user_id='f3e440baf598481ea81d02228699d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7feabf89-323c-4f10-9057-e52fafa3a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7feabf89-323c-4f10-9057-e52fafa3a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a443007e-5ee0-440f-988e-fc862ad38f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a443007e-5ee0-440f-988e-fc862ad38f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425ad7a8-1c3d-4558-8c6b-1a86af5b60e2', 'volume_name': 'volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37bc9e1-28a7-48cb-b41f-e6253bf01259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37bc9e1-28a7-48cb-b41f-e6253bf01259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323608d5-f250-452a-923f-703a247bb17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:41 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Volume 425ad7a8-1c3d-4558-8c6b-1a86af5b60e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2', 'volume_size': 1} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:41 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 1073741824" returned: 0 in 1.031s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:41 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 Jun 12 04:45:41 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:42 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1942676667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425ad7a8-1c3d-4558-8c6b-1a86af5b60e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f4a8835f82427a90b37fbf7d18b2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:45:41Z,use_quota=True,user_id='f3e440baf598481ea81d02228699d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Creating volume 425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:45:42 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ad5ace-b8f5-48c4-b423-14dc7bb9aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a052636-3519-4e0b-9810-4c0a975fb021', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:42 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 1073741824 Jun 12 04:45:42 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e58d1d-9d54-4816-8dbb-a4deb17d8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:42 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Volume volume-2a052636-3519-4e0b-9810-4c0a975fb021 (2a052636-3519-4e0b-9810-4c0a975fb021): created successfully Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e58d1d-9d54-4816-8dbb-a4deb17d8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Flow 'volume_create_manager' (f1efeb41-aa02-454b-bcaf-ab8edfad99be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:42 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7020cfb4-1a3a-4d04-9f51-6b6c5cb639db tempest-ServersNegativeTestJSON-1482150258 None] Created volume successfully. Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "cinder-2a052636-3519-4e0b-9810-4c0a975fb021-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:45:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-2a052636-3519-4e0b-9810-4c0a975fb021-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "cinder-quobyte-2a052636-3519-4e0b-9810-4c0a975fb021" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-quobyte-2a052636-3519-4e0b-9810-4c0a975fb021" acquired by "delete_volume" :: waited 0.030s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0740fa8-d184-4ca1-b400-6418336f2b64]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:43 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 Jun 12 04:45:43 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:43 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 1073741824" returned: 0 in 0.963s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:43 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 Jun 12 04:45:43 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:43 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021" returned: 0 in 0.869s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:44 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021 Jun 12 04:45:44 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:44 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" returned: 0 in 0.686s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323608d5-f250-452a-923f-703a247bb17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ff1a7d-abda-45e7-8eee-e89c8c9952de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:45:44 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Volume volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 (425ad7a8-1c3d-4558-8c6b-1a86af5b60e2): created successfully Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ff1a7d-abda-45e7-8eee-e89c8c9952de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Flow 'volume_create_manager' (9cee3761-ab12-496d-af82-66bf7c8a764e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:45:44 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1a4a3e91-f52c-47cb-a81e-09b44950fbf5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Created volume successfully. Jun 12 04:45:44 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a052636-3519-4e0b-9810-4c0a975fb021" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-quobyte-2a052636-3519-4e0b-9810-4c0a975fb021" released by "delete_volume" :: held 1.566s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Created reservations ['9bfdb0ce-a794-4f23-80e6-b327ea5d505d', 'a07dc7ff-b01d-4398-bbcb-709d262a373a', '26d3dfbb-eca3-4f5e-a519-5fdb8c69963a', 'ef0da307-a75e-4f01-8bf3-7615432aeb57'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:44 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:45:44 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "cinder-e0f029c8-5108-4669-b260-e7125f27c284-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-e0f029c8-5108-4669-b260-e7125f27c284-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "cinder-quobyte-e0f029c8-5108-4669-b260-e7125f27c284" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-quobyte-e0f029c8-5108-4669-b260-e7125f27c284" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:45:45 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.612s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[508312af-c5cf-4976-bd0c-0a38bb61b6ae]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:45:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Deleted volume successfully. Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-72941e60-c9c8-4578-a285-1bfd068868b4 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-2a052636-3519-4e0b-9810-4c0a975fb021-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:45:45 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 Jun 12 04:45:45 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:46 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284" returned: 0 in 1.103s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:46 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284 Jun 12 04:45:46 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:47 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e0f029c8-5108-4669-b260-e7125f27c284" returned: 0 in 1.187s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8608ac41-9de2-43bd-9b60-2a8a70765ad7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-quobyte-e0f029c8-5108-4669-b260-e7125f27c284" released by "delete_volume" :: held 2.378s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Created reservations ['52871956-59b4-4b76-bcc3-1c829ce283ea', 'e347b801-65ff-4de2-8a2c-d874ac085b31', '6438476c-dbf5-4ac6-8926-99f1cab77125', '0522c896-1b89-4abe-a7b5-9147a78f65d0'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:45:47 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 Jun 12 04:45:47 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:47 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:45:47 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:45:48 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" returned: 0 in 0.915s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:45:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fccc116e-2b5e-4641-8c87-f77370421f66', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:45:48 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jun 12 04:45:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.823s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:45:48 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:45:48 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Deleted volume successfully. Jun 12 04:45:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-27ed45fd-38d1-4613-ab98-ad3c3bdccee0 tempest-ServersNegativeTestJSON-1482150258 None] Lock "cinder-e0f029c8-5108-4669-b260-e7125f27c284-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:45:48 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-1672e95b-2f83-4068-b184-021bcf4f3657 req-6085c42a-e414-4076-9ee0-3f10ecc01ead tempest-TestServerVolumeAttachmentScenario-1406159928 None] attachment_update completed successfully. Jun 12 04:45:58 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=35,cinder:SELECT=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:45:58 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=34,cinder:UPDATE=27,cinder:DELETE=5,cinder:INSERT=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:45:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:45:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:45:59 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9bb563-e196-453c-844f-f74bda09b1fd]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:45:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:45:59 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 Jun 12 04:45:59 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:00 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492" returned: 0 in 0.993s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.049s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-c32ee205-d894-48c3-b20b-5d784d035492', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cad044c7-c8ab-4fcf-a30a-c4660ba08a48', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:46:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-8c35473b-3a43-4e77-94fa-606a9c107867 req-fbcf29b0-d411-45d9-b0bb-caa642ca835b tempest-TestServerVolumeAttachmentScenario-1406159928 None] attachment_update completed successfully. Jun 12 04:46:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Flow 'volume_create_manager' (b80e5845-bd4d-48c0-8d6a-9fe7ae128a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed81a227-a2f7-4b76-8945-b5459bf332ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed81a227-a2f7-4b76-8945-b5459bf332ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-209099060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302f9eb8-939f-4f84-8e27-13f5b5cb4e4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a144748e55440dadcb2ac36d7f03da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:05Z,use_quota=True,user_id='fc246bf95abd44788dc10613244bdd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47241609-dd6d-41bd-89ec-47da94ce3410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47241609-dd6d-41bd-89ec-47da94ce3410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc80dff4-c31f-4feb-967a-5ec47cc05d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc80dff4-c31f-4feb-967a-5ec47cc05d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302f9eb8-939f-4f84-8e27-13f5b5cb4e4a', 'volume_name': 'volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eecfe9a4-edd6-4e80-abd3-02e8373972e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eecfe9a4-edd6-4e80-abd3-02e8373972e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44756ad-6f19-4c05-b4e9-0c138c74fee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Volume 302f9eb8-939f-4f84-8e27-13f5b5cb4e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a', 'volume_size': 1} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-209099060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302f9eb8-939f-4f84-8e27-13f5b5cb4e4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a144748e55440dadcb2ac36d7f03da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:05Z,use_quota=True,user_id='fc246bf95abd44788dc10613244bdd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Creating volume 302f9eb8-939f-4f84-8e27-13f5b5cb4e4a {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:46:05 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:46:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:05 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a 1073741824 Jun 12 04:46:05 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:06 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a 1073741824" returned: 0 in 0.992s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:06 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a Jun 12 04:46:06 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:06 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a" returned: 0 in 0.788s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.109s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44756ad-6f19-4c05-b4e9-0c138c74fee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9675cf-904d-47dd-865f-e6fbf8728140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948a66d-d713-4d10-9399-18db10398373]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:06 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Volume volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a (302f9eb8-939f-4f84-8e27-13f5b5cb4e4a): created successfully Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9675cf-904d-47dd-865f-e6fbf8728140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Flow 'volume_create_manager' (b80e5845-bd4d-48c0-8d6a-9fe7ae128a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-dc113963-9f3a-455f-ad84-304296a5e07a tempest-VolumesTestJSON-575231621 None] Created volume successfully. Jun 12 04:46:07 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 Jun 12 04:46:07 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-d3b43c24-5dbd-4f9f-a3e2-20f2c289ef7b req-1e0e1f73-0b4b-423d-ae47-232b3c9574cb tempest-TestServerVolumeAttachmentScenario-1406159928 None] Terminate volume connection completed successfully. Jun 12 04:46:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-d3b43c24-5dbd-4f9f-a3e2-20f2c289ef7b req-1e0e1f73-0b4b-423d-ae47-232b3c9574cb tempest-TestServerVolumeAttachmentScenario-1406159928 None] Deleting attachment cad044c7-c8ab-4fcf-a30a-c4660ba08a48. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:46:07 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:46:07 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Flow 'volume_create_manager' (21d0fc84-60eb-43db-93ae-007b670bb388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b143bc1b-13d4-4cd8-90bd-a98fc6fd5cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" returned: 0 in 1.056s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b143bc1b-13d4-4cd8-90bd-a98fc6fd5cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1636914290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872b8892-d586-4cb9-b2b3-8fa1b68e8cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a144748e55440dadcb2ac36d7f03da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:08Z,use_quota=True,user_id='fc246bf95abd44788dc10613244bdd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3339101-3003-4968-812b-87527d513df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3339101-3003-4968-812b-87527d513df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c6e0ea-86cd-4aa1-b907-18fe7ce908b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c6e0ea-86cd-4aa1-b907-18fe7ce908b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872b8892-d586-4cb9-b2b3-8fa1b68e8cdb', 'volume_name': 'volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721b9674-6b7b-436d-8c33-8e867d590852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721b9674-6b7b-436d-8c33-8e867d590852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec44bd7-bfd6-45af-8780-07f63b54160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:08 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Volume 872b8892-d586-4cb9-b2b3-8fa1b68e8cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb', 'volume_size': 1} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1636914290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872b8892-d586-4cb9-b2b3-8fa1b68e8cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a144748e55440dadcb2ac36d7f03da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:08Z,use_quota=True,user_id='fc246bf95abd44788dc10613244bdd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Creating volume 872b8892-d586-4cb9-b2b3-8fa1b68e8cdb {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:46:08 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:08 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb 1073741824 Jun 12 04:46:08 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9435d42e-0cdd-49f6-b8d1-09ca7f23d427', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:46:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-9020a255-5385-4227-92e3-6db0357f9d84 req-deca82a9-1447-4208-9b6a-3aa905ac9e0b tempest-AttachVolumeShelveTestJSON-1594784273 None] attachment_update completed successfully. Jun 12 04:46:08 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb 1073741824" returned: 0 in 0.885s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:09 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb Jun 12 04:46:09 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:09 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb" returned: 0 in 0.683s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec44bd7-bfd6-45af-8780-07f63b54160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3960bfbd-2431-4f42-bd51-2b15a1bb5449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Volume volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb (872b8892-d586-4cb9-b2b3-8fa1b68e8cdb): created successfully Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3960bfbd-2431-4f42-bd51-2b15a1bb5449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Flow 'volume_create_manager' (21d0fc84-60eb-43db-93ae-007b670bb388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4f850233-6c98-4d3b-a1a9-d973179beed9 tempest-VolumesTestJSON-575231621 None] Created volume successfully. Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Flow 'volume_create_manager' (46a89b66-b41b-4283-a47b-53980d86f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dcaeec-c6e3-4ea9-ba45-f9eb8139c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33dcaeec-c6e3-4ea9-ba45-f9eb8139c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1906053402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75ea848-2d64-4943-b15b-f0f7eb5ace71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a144748e55440dadcb2ac36d7f03da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:11Z,use_quota=True,user_id='fc246bf95abd44788dc10613244bdd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e0e14e-6d14-428c-9be9-06d5b88ea87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e0e14e-6d14-428c-9be9-06d5b88ea87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f5c6e6-ad83-4d4b-961e-987e5dbf5528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f5c6e6-ad83-4d4b-961e-987e5dbf5528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75ea848-2d64-4943-b15b-f0f7eb5ace71', 'volume_name': 'volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3024e2b1-7ce4-4bb8-af1b-f9f80500ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3024e2b1-7ce4-4bb8-af1b-f9f80500ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fe9d07-6361-45a3-aff7-2e7c3c92a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:11 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Volume a75ea848-2d64-4943-b15b-f0f7eb5ace71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71', 'volume_size': 1} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1906053402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75ea848-2d64-4943-b15b-f0f7eb5ace71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a144748e55440dadcb2ac36d7f03da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:11Z,use_quota=True,user_id='fc246bf95abd44788dc10613244bdd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Creating volume a75ea848-2d64-4943-b15b-f0f7eb5ace71 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:46:11 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:11 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 1073741824 Jun 12 04:46:11 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-fe8c4ccc-9942-4160-b572-cea947e94031 req-3b12ba62-f24c-4fb4-9125-559393f4eba5 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Terminate volume connection completed successfully. Jun 12 04:46:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-fe8c4ccc-9942-4160-b572-cea947e94031 req-3b12ba62-f24c-4fb4-9125-559393f4eba5 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Deleting attachment fccc116e-2b5e-4641-8c87-f77370421f66. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:46:12 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 1073741824" returned: 0 in 0.783s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:12 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 Jun 12 04:46:12 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:12 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71" returned: 0 in 0.629s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fe9d07-6361-45a3-aff7-2e7c3c92a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5da0c28-6245-450b-8a56-88a5b76e692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Volume volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 (a75ea848-2d64-4943-b15b-f0f7eb5ace71): created successfully Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5da0c28-6245-450b-8a56-88a5b76e692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Flow 'volume_create_manager' (46a89b66-b41b-4283-a47b-53980d86f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5171312a-0f5b-470f-92e6-f6cfc22b8537 tempest-VolumesTestJSON-575231621 None] Created volume successfully. Jun 12 04:46:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Acquiring lock "cinder-a75ea848-2d64-4943-b15b-f0f7eb5ace71-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Lock "cinder-a75ea848-2d64-4943-b15b-f0f7eb5ace71-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Acquiring lock "cinder-quobyte-a75ea848-2d64-4943-b15b-f0f7eb5ace71" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Lock "cinder-quobyte-a75ea848-2d64-4943-b15b-f0f7eb5ace71" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[581158b5-f668-4b19-9678-e1cd2223d47d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:14 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 Jun 12 04:46:14 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:15 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71" returned: 0 in 0.865s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:15 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71 Jun 12 04:46:15 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:15 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a75ea848-2d64-4943-b15b-f0f7eb5ace71" returned: 0 in 0.656s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Lock "cinder-quobyte-a75ea848-2d64-4943-b15b-f0f7eb5ace71" released by "delete_volume" :: held 1.560s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Created reservations ['78a9f48e-b054-4808-9c39-339c2948a074', '1da32491-4db9-4ade-a485-139d21fe3c6d', 'f4ce21f4-d203-4e44-9c5c-65eb9fc07717', 'b6f398a3-21f1-49b2-9076-3cd433741c23'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:15 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:15 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Acquiring lock "cinder-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Lock "cinder-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Acquiring lock "cinder-quobyte-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Lock "cinder-quobyte-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e44fcf9-57b7-4ad5-8af4-42b4bf919c74]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:16 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.743s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Deleted volume successfully. Jun 12 04:46:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-503eb6a5-f5ab-49c5-944d-d23f2c8a66de tempest-VolumesTestJSON-575231621 None] Lock "cinder-a75ea848-2d64-4943-b15b-f0f7eb5ace71-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:16 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb Jun 12 04:46:16 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:17 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb" returned: 0 in 1.063s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:17 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb Jun 12 04:46:17 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:18 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb" returned: 0 in 0.742s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Lock "cinder-quobyte-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb" released by "delete_volume" :: held 1.906s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Created reservations ['b80b35cd-d0fb-4311-84b2-fa187784574c', 'b6b02c0f-159f-4621-bd7f-1606d79255d2', '12896ab6-310b-454b-a2fb-ac7deb46696f', '637ad94c-7087-4ef3-9bb0-43db8ea20977'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:18 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:18 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:19 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.666s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Deleted volume successfully. Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3e50b42-359d-4050-b4c6-7bed42c4adb6 tempest-VolumesTestJSON-575231621 None] Lock "cinder-872b8892-d586-4cb9-b2b3-8fa1b68e8cdb-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Acquiring lock "cinder-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Lock "cinder-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Acquiring lock "cinder-quobyte-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Lock "cinder-quobyte-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7929f0a4-974c-48d7-aee0-e7d486cdf84d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:20 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a Jun 12 04:46:20 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:20 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a" returned: 0 in 0.722s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:20 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a Jun 12 04:46:20 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:21 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a" returned: 0 in 0.745s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Lock "cinder-quobyte-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a" released by "delete_volume" :: held 1.511s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Created reservations ['0b8b709f-cddd-4320-9e7a-0f3e82469724', '23413d00-27d1-417e-8c8e-21a3188f223c', '015a3de7-6793-4bc5-8d2b-aee9bb14f85a', '3f531667-6e64-4b55-82ac-f3eb22759076'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:21 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:21 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "cinder-c32ee205-d894-48c3-b20b-5d784d035492-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-c32ee205-d894-48c3-b20b-5d784d035492-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:22 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.701s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Deleted volume successfully. Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "cinder-quobyte-c32ee205-d894-48c3-b20b-5d784d035492" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2b921b5e-1b95-4570-8e80-1287a5ea4b09 tempest-VolumesTestJSON-575231621 None] Lock "cinder-302f9eb8-939f-4f84-8e27-13f5b5cb4e4a-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-quobyte-c32ee205-d894-48c3-b20b-5d784d035492" acquired by "delete_volume" :: waited 0.038s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb800a00-c6f6-4afc-903a-e6b47d462dcd]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:22 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 Jun 12 04:46:22 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-bfacb159-1649-4620-b742-05def1a9aa7e req-11f90ce3-3fc7-499b-9bfa-2ebeae466783 tempest-AttachVolumeTestJSON-732787644 None] Terminate volume connection completed successfully. Jun 12 04:46:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-bfacb159-1649-4620-b742-05def1a9aa7e req-11f90ce3-3fc7-499b-9bfa-2ebeae466783 tempest-AttachVolumeTestJSON-732787644 None] Deleting attachment 8cc24836-3c1f-43c1-bf69-db0dd82da39d. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:46:23 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492" returned: 0 in 0.792s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:23 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492 Jun 12 04:46:23 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:24 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c32ee205-d894-48c3-b20b-5d784d035492" returned: 0 in 0.806s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-quobyte-c32ee205-d894-48c3-b20b-5d784d035492" released by "delete_volume" :: held 1.671s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Created reservations ['ee9951ce-6d8c-4c84-85ce-0ab200b29360', '9515e42c-cf35-4c37-8eaf-8fa91a223374', 'dc15ea6b-315d-4c9c-a622-f608aac468cc', '336a44dc-0d15-4daa-b714-6bc8b439f42d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:24 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:24 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "cinder-1927e7a9-cfdd-47aa-b95f-ba7335e511e0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-1927e7a9-cfdd-47aa-b95f-ba7335e511e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "cinder-quobyte-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-quobyte-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d2f8bc-9d04-4161-9590-b7e1ac9b6c4f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:24 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 Jun 12 04:46:24 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:24 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.774s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:24 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Deleted volume successfully. Jun 12 04:46:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-908755af-7291-4a03-a05b-9b6dbaff5286 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-c32ee205-d894-48c3-b20b-5d784d035492-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:25 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" returned: 0 in 1.166s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:25 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0 Jun 12 04:46:25 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:26 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" returned: 0 in 0.742s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-quobyte-1927e7a9-cfdd-47aa-b95f-ba7335e511e0" released by "delete_volume" :: held 1.963s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Created reservations ['565828b5-e2fe-4754-a613-cc662b21fecc', '1f70074d-0cd7-4c27-84c5-344d68a67635', '8fc76749-f58f-4b45-a663-d457e35d655c', 'af893d94-1723-4cb1-a46b-a9cad2bb2847'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:26 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:26 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fa9b4bb0-e319-45ac-a3a7-1eeda0e7a174 tempest-GroupSnapshotsTest-2116745330 None] Group tempest-GroupSnapshotsTest-Group-1945450759: creating Jun 12 04:46:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fa9b4bb0-e319-45ac-a3a7-1eeda0e7a174 tempest-GroupSnapshotsTest-2116745330 None] Group tempest-GroupSnapshotsTest-Group-1945450759: created successfully Jun 12 04:46:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fa9b4bb0-e319-45ac-a3a7-1eeda0e7a174 tempest-GroupSnapshotsTest-2116745330 None] Create group completed successfully. Jun 12 04:46:27 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:27 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Deleted volume successfully. Jun 12 04:46:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e8397ebe-449e-449a-a26c-3e072e38a8b4 tempest-TestServerVolumeAttachmentScenario-1406159928 None] Lock "cinder-1927e7a9-cfdd-47aa-b95f-ba7335e511e0-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-9020a255-5385-4227-92e3-6db0357f9d84 req-304fee05-4584-49ab-b9ba-50049b7d4b24 tempest-AttachVolumeShelveTestJSON-1594784273 None] Terminate volume connection completed successfully. Jun 12 04:46:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-9020a255-5385-4227-92e3-6db0357f9d84 req-304fee05-4584-49ab-b9ba-50049b7d4b24 tempest-AttachVolumeShelveTestJSON-1594784273 None] Deleting attachment 9435d42e-0cdd-49f6-b8d1-09ca7f23d427. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (ab6ddbe6-8314-481e-bf46-ce7e5857062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0244b74a-67a8-48b1-83a5-6dc954089f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0244b74a-67a8-48b1-83a5-6dc954089f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361537780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2bcf270-4166-430f-b89b-8e2e4d28a03d,host='devstack@QuobyteHD#QuobyteHD',id=abda788e-3e1d-4abc-8499-c81c2622f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:28Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc3381b7-5c91-458e-bf22-a2ba07b80e92),volume_type_id=fc3381b7-5c91-458e-bf22-a2ba07b80e92)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a56a66-8d51-4ab1-aaa4-1549d72ce494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a56a66-8d51-4ab1-aaa4-1549d72ce494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f4536-0e6a-457a-adac-c2a26041e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f4536-0e6a-457a-adac-c2a26041e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abda788e-3e1d-4abc-8499-c81c2622f2a9', 'volume_name': 'volume-abda788e-3e1d-4abc-8499-c81c2622f2a9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fbed69-1aac-4b17-a302-af610628c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fbed69-1aac-4b17-a302-af610628c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6556ac-f219-4aaa-a137-d1d8df78f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:28 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Volume abda788e-3e1d-4abc-8499-c81c2622f2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abda788e-3e1d-4abc-8499-c81c2622f2a9', 'volume_size': 1} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2bcf270-4166-430f-b89b-8e2e4d28a03d,created_at=2026-06-12T02:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361537780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2bcf270-4166-430f-b89b-8e2e4d28a03d,host='devstack@QuobyteHD#QuobyteHD',id=abda788e-3e1d-4abc-8499-c81c2622f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:46:28Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc3381b7-5c91-458e-bf22-a2ba07b80e92),volume_type_id=fc3381b7-5c91-458e-bf22-a2ba07b80e92)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Creating volume abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:46:28 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:46:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:28 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 1073741824 Jun 12 04:46:28 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:29 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 1073741824" returned: 0 in 0.936s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:29 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:29 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:30 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 0.711s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6556ac-f219-4aaa-a137-d1d8df78f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abda788e-3e1d-4abc-8499-c81c2622f2a9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b0d29c-f706-4ef3-8501-fe39f88f3e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:46:30 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Volume volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 (abda788e-3e1d-4abc-8499-c81c2622f2a9): created successfully Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b0d29c-f706-4ef3-8501-fe39f88f3e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (ab6ddbe6-8314-481e-bf46-ce7e5857062b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:46:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6123495f-4c7d-423e-bd60-f828e7dad59d tempest-GroupSnapshotsTest-2116745330 None] Created volume successfully. Jun 12 04:46:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] GroupSnapshot 87e70752-2fdd-4c6a-863b-3d23db763fd9: creating. Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Group snapshot 87e70752-2fdd-4c6a-863b-3d23db763fd9: creating. {{(pid=92320) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4187}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Creating offline snapshot e027a87b-58e7-4bf9-a724-7a21263d038a of volume abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77aa346-cb2b-4efd-b8b9-bc1b7335b252]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:31 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:31 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:31 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 0.719s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:31 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a 1G Jun 12 04:46:31 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:31 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:31 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:32 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.706s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:46:32 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a 1G" returned: 0 in 0.877s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:32 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a Jun 12 04:46:32 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:33 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:33 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:46:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:33 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a Jun 12 04:46:33 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:33 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:34 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info Jun 12 04:46:34 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:34 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:34 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:46:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:34 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info Jun 12 04:46:34 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:35 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.info" returned: 0 in 0.855s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.606s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:35 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6fb7c188-5558-48e5-a24b-0656ad3c3e04 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot 87e70752-2fdd-4c6a-863b-3d23db763fd9: created successfully Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-e027a87b-58e7-4bf9-a724-7a21263d038a-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-e027a87b-58e7-4bf9-a724-7a21263d038a-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Creating volume 13d78f5c-d2ef-4970-bada-693f2cbe0d4b from snapshot e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] snapshot: e027a87b-58e7-4bf9-a724-7a21263d038a, volume: 13d78f5c-d2ef-4970-bada-693f2cbe0d4b, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc2fff2-78db-4ef1-be67-977fc25bbbaf]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:37 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a Jun 12 04:46:37 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:38 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a" returned: 0 in 0.891s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abda788e-3e1d-4abc-8499-c81c2622f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:46:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 04:46:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 04:46:38 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31adaae-936e-4cee-a0a0-74b3741933bd]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:38 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:38 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:39 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 0.998s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:39 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 04:46:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:39 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b Jun 12 04:46:39 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:46 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" returned: 0 in 7.278s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:46 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3cac83-6c96-44b3-a257-b527c0578f70]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:47 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:47 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:47 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=62,cinder:UPDATE=54,cinder:INSERT=14,cinder:DELETE=5 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:46:47 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=59,cinder:UPDATE=63,cinder:INSERT=11,cinder:DELETE=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:46:48 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 1.080s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:46:48 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Converted 1024.00 MB image at 140.66 MB/s Jun 12 04:46:48 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:48 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b Jun 12 04:46:48 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:48 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" returned: 0 in 0.705s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" released by "_copy_volume_from_snapshot" :: held 11.156s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-e027a87b-58e7-4bf9-a724-7a21263d038a-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" released by "_create_volume_from_snapshot" :: held 11.209s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.228s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:48 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-994408e4-6872-4fb5-8ae5-fc01c7f9bd58 tempest-GroupSnapshotsTest-2116745330 None] Create group from source-snapshot-87e70752-2fdd-4c6a-863b-3d23db763fd9 completed successfully. Jun 12 04:46:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1ef558-6b9d-4677-982e-45383f68a35a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:50 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b Jun 12 04:46:50 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:50 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" returned: 0 in 0.772s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:50 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b Jun 12 04:46:50 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:51 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" returned: 0 in 0.589s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-13d78f5c-d2ef-4970-bada-693f2cbe0d4b" released by "delete_volume" :: held 1.410s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['da6e42b1-a5c0-4732-a3d6-8743d44a8d6f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:51 devstack cinder-volume[92320]: WARNING cinder.quota [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2124958048 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2124958048, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:46:51 devstack cinder-volume[92320]: WARNING cinder.quota [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2124958048 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2124958048, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['c09f7279-dd51-4688-a35e-d73a934fc29d', 'f313ad39-dac2-44e7-83e3-e4c5da9211a4', '80193427-10c8-4ee0-850d-516c65cd7de5', '7f1595af-63d1-4048-bbfd-61e92ab2df3d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:51 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:51 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] group_snapshot 87e70752-2fdd-4c6a-863b-3d23db763fd9: deleting Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] group_snapshot 87e70752-2fdd-4c6a-863b-3d23db763fd9: deleting {{(pid=92320) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4362}} Jun 12 04:46:52 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.694s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6be7e7a2-f3c2-4c43-8126-fa05c6b44d7b tempest-GroupSnapshotsTest-2116745330 None] Delete group completed successfully. Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-abda788e-3e1d-4abc-8499-c81c2622f2a9" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-abda788e-3e1d-4abc-8499-c81c2622f2a9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-e027a87b-58e7-4bf9-a724-7a21263d038a" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-e027a87b-58e7-4bf9-a724-7a21263d038a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Deleting offline snapshot e027a87b-58e7-4bf9-a724-7a21263d038a of volume abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] snapshot_file for this snap is: volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[671da5a1-ca3f-4c96-be69-6359be338248]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:52 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a Jun 12 04:46:52 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:53 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a" returned: 0 in 0.787s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abda788e-3e1d-4abc-8499-c81c2622f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:46:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03780ce-4f61-421d-bfc4-d1c36cdc2ab1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:53 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:53 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:54 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:54 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a Jun 12 04:46:54 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:54 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a" returned: 0 in 0.793s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:54 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a Jun 12 04:46:54 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:55 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9.e027a87b-58e7-4bf9-a724-7a21263d038a" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-e027a87b-58e7-4bf9-a724-7a21263d038a" released by "_delete_snapshot" :: held 3.090s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-abda788e-3e1d-4abc-8499-c81c2622f2a9" released by "delete_snapshot" :: held 3.128s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:55 devstack cinder-volume[92320]: WARNING cinder.quota [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2124958048 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2124958048, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:46:55 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['a1d3ccbf-f66d-45ec-92c3-0bb5afa8ef57', '56e44ac5-8b0b-4cb6-8660-b68bf00e1a26', 'a455e498-3a29-46e1-95bd-27183356c8ef', '09d4526f-f0be-4e54-a994-ae805e17f9c2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:55 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ceef8d71-1c14-4e73-b6e5-80127a49778c tempest-GroupSnapshotsTest-2116745330 None] group_snapshot 87e70752-2fdd-4c6a-863b-3d23db763fd9: deleted successfully Jun 12 04:46:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-abda788e-3e1d-4abc-8499-c81c2622f2a9" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:46:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-abda788e-3e1d-4abc-8499-c81c2622f2a9" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:46:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8417a3d8-13eb-4be8-86eb-dc512e7ce41d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:46:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:57 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:57 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:57 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 0.784s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:57 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9 Jun 12 04:46:57 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:58 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-abda788e-3e1d-4abc-8499-c81c2622f2a9" returned: 0 in 0.606s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-abda788e-3e1d-4abc-8499-c81c2622f2a9" released by "delete_volume" :: held 1.467s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['1649da42-021b-47fc-89e5-5f677b2012ef'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:58 devstack cinder-volume[92320]: WARNING cinder.db.sqlalchemy.api [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2124958048'] Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['1edf49f0-ce5e-4116-a51f-ac32c29fb22d', 'ad14b471-351a-4f8e-be99-6c9be84e3e2e', '293cd2bd-8c75-4652-93e1-290249598b1c', '3a0486f7-9a69-4949-b548-bf16290e5bb8'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:46:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:46:58 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:46:58 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:46:59 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jun 12 04:46:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.897s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:46:59 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:46:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4c2b934e-e576-4afc-aa25-879f27d75d1e tempest-GroupSnapshotsTest-2116745330 None] Delete group completed successfully. Jun 12 04:47:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3aea07f6-5c57-43b9-be68-33379868e335 tempest-GroupSnapshotsTest-2116745330 None] Group tempest-GroupSnapshotsTest-Group-1189362082: creating Jun 12 04:47:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3aea07f6-5c57-43b9-be68-33379868e335 tempest-GroupSnapshotsTest-2116745330 None] Group tempest-GroupSnapshotsTest-Group-1189362082: created successfully Jun 12 04:47:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3aea07f6-5c57-43b9-be68-33379868e335 tempest-GroupSnapshotsTest-2116745330 None] Create group completed successfully. Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (93655a61-16fd-40a1-9484-f15609602d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed948147-853e-40d2-987f-1e81febf87fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed948147-853e-40d2-987f-1e81febf87fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200231442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1b661f2-6752-40b3-9a43-4ae7fe005d4e,host='devstack@QuobyteHD#QuobyteHD',id=c68e2102-4397-4312-9d94-b6c1bc64bbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:02Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350dad75-307e-40ef-ab0b-0b0000c52e3f),volume_type_id=350dad75-307e-40ef-ab0b-0b0000c52e3f)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7fec12-b83d-4b34-939f-068fa253e95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7fec12-b83d-4b34-939f-068fa253e95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27636254-7724-458f-bdcc-5a77ce68b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27636254-7724-458f-bdcc-5a77ce68b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68e2102-4397-4312-9d94-b6c1bc64bbcd', 'volume_name': 'volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b91abf7-20df-47e8-af01-d69a81e27461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b91abf7-20df-47e8-af01-d69a81e27461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff73c142-24df-4828-b006-88eb48bddb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:01 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Volume c68e2102-4397-4312-9d94-b6c1bc64bbcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd', 'volume_size': 1} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1b661f2-6752-40b3-9a43-4ae7fe005d4e,created_at=2026-06-12T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200231442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1b661f2-6752-40b3-9a43-4ae7fe005d4e,host='devstack@QuobyteHD#QuobyteHD',id=c68e2102-4397-4312-9d94-b6c1bc64bbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:02Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350dad75-307e-40ef-ab0b-0b0000c52e3f),volume_type_id=350dad75-307e-40ef-ab0b-0b0000c52e3f)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Creating volume c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:47:01 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:47:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:01 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd 1073741824 Jun 12 04:47:01 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:02 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd 1073741824" returned: 0 in 1.063s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:02 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd Jun 12 04:47:02 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:03 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd" returned: 0 in 0.683s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff73c142-24df-4828-b006-88eb48bddb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1765df6-b305-497b-8d7f-35f865f153c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:03 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Volume volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd (c68e2102-4397-4312-9d94-b6c1bc64bbcd): created successfully Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1765df6-b305-497b-8d7f-35f865f153c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (93655a61-16fd-40a1-9484-f15609602d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e0f54238-fd4e-4f85-88c7-d5159f68277a tempest-GroupSnapshotsTest-2116745330 None] Created volume successfully. Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (761c79c8-45ec-45a7-acde-17b64cefd591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0472404-f80d-4eb9-aec8-7ca3cf74e509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0472404-f80d-4eb9-aec8-7ca3cf74e509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764971852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1b661f2-6752-40b3-9a43-4ae7fe005d4e,host='devstack@QuobyteHD#QuobyteHD',id=b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:04Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350dad75-307e-40ef-ab0b-0b0000c52e3f),volume_type_id=350dad75-307e-40ef-ab0b-0b0000c52e3f)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a2266b-6fee-45ac-bfd3-2895e89948ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a2266b-6fee-45ac-bfd3-2895e89948ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b8125f-d30f-4b29-ac68-a0ebcae58582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b8125f-d30f-4b29-ac68-a0ebcae58582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a', 'volume_name': 'volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173cf5cc-1639-417e-a80a-81c06f88c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173cf5cc-1639-417e-a80a-81c06f88c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce270754-ecb5-486d-9ca3-d1df10268f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Volume b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a', 'volume_size': 1} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1b661f2-6752-40b3-9a43-4ae7fe005d4e,created_at=2026-06-12T02:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764971852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1b661f2-6752-40b3-9a43-4ae7fe005d4e,host='devstack@QuobyteHD#QuobyteHD',id=b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:04Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350dad75-307e-40ef-ab0b-0b0000c52e3f),volume_type_id=350dad75-307e-40ef-ab0b-0b0000c52e3f)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Creating volume b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:47:04 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:47:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:04 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a 1073741824 Jun 12 04:47:04 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:05 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a 1073741824" returned: 0 in 0.912s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:05 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a Jun 12 04:47:05 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:06 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce270754-ecb5-486d-9ca3-d1df10268f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e34e0d2-94a2-42b1-8c99-8930c7f2653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:06 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Volume volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a (b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a): created successfully Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e34e0d2-94a2-42b1-8c99-8930c7f2653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (761c79c8-45ec-45a7-acde-17b64cefd591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c0e0b4c6-d293-4b02-aac6-76f40bd1649b tempest-GroupSnapshotsTest-2116745330 None] Created volume successfully. Jun 12 04:47:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-719108ac-40ac-4c7a-9252-af21990406c2 tempest-GroupSnapshotsTest-2116745330 None] Update group completed successfully. Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Flow 'volume_create_manager' (2a5d3b65-635e-4fd3-9e23-e2382ac45598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60dbc0f-4b98-4aff-bc44-d96b7325330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60dbc0f-4b98-4aff-bc44-d96b7325330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-262542977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92d26d2-2d6c-407a-8f84-1882f9368b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2c304fdcad4cf5aedf65814d8a7eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:07Z,use_quota=True,user_id='b4bfa7a970df4192b642b6b0ce5a43f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6707ae-cb1e-4be2-800c-4d425f0b8a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6707ae-cb1e-4be2-800c-4d425f0b8a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c97e7c3-5b97-4d60-bf25-4ac06c40b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:07 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c97e7c3-5b97-4d60-bf25-4ac06c40b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e92d26d2-2d6c-407a-8f84-1882f9368b4e', 'volume_name': 'volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe9aace-5930-4d5a-8ed1-0cdc602970d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe9aace-5930-4d5a-8ed1-0cdc602970d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce0a8e3-d8e4-4b7f-9816-93d504d804b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:08 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Volume e92d26d2-2d6c-407a-8f84-1882f9368b4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Trying to clone e92d26d2-2d6c-407a-8f84-1882f9368b4e from image 23fce906-aa03-46a6-9408-5b9570e89c54 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 04:47:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1912017b-85ed-438e-b1b3-25bf41ebbf6d tempest-GroupSnapshotsTest-2116745330 None] Update group completed successfully. Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 04:47:08 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Image download 20.69 MB at 20.69 MB/s Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe0578f-9e05-4a4e-a288-c35054bead84]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:08 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD Jun 12 04:47:08 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:09 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 is fetched for user b4bfa7a970df4192b642b6b0ce5a43f8. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebae4b5-37dd-4204-b1c2-8f4673362d71]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2ff9c96e-1efa-43a4-97ae-7ef5cee06235 tempest-GroupSnapshotsTest-2116745330 None] Update group completed successfully. Jun 12 04:47:09 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD Jun 12 04:47:09 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:09 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD" returned: 0 in 0.685s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-262542977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92d26d2-2d6c-407a-8f84-1882f9368b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2c304fdcad4cf5aedf65814d8a7eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:07Z,use_quota=True,user_id='b4bfa7a970df4192b642b6b0ce5a43f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Creating volume e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:47:09 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:47:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:09 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e 1073741824 Jun 12 04:47:09 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:10 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d110eb09-054e-42f4-a6f5-9175e276f729 tempest-GroupSnapshotsTest-2116745330 None] Update group completed successfully. Jun 12 04:47:10 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e 1073741824" returned: 0 in 0.901s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:10 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:47:10 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:11 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Attempting download of 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume e92d26d2-2d6c-407a-8f84-1882f9368b4e. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b0b25-c21e-4cf6-82f2-69411927242c]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:11 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6 Jun 12 04:47:11 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] GroupSnapshot e9d48fc6-fea1-425b-9fa6-747a771622b3: creating. Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Group snapshot e9d48fc6-fea1-425b-9fa6-747a771622b3: creating. {{(pid=92320) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4187}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Creating offline snapshot b937846b-494b-412b-9c53-f26c84122b29 of volume c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[64950a04-7a5c-4238-9f2f-103188bce551]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:12 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd Jun 12 04:47:12 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:12 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6" returned: 0 in 0.764s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:12 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6 Jun 12 04:47:12 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:12 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd" returned: 0 in 0.844s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:12 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 1G Jun 12 04:47:12 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:13 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6" returned: 1 in 0.817s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_o7u0vda6' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a66d406-a5d0-45f4-ab47-6415d1c10d10]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:13 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD Jun 12 04:47:13 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:13 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 1G" returned: 0 in 0.784s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:13 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 Jun 12 04:47:13 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:13 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] 23fce906-aa03-46a6-9408-5b9570e89c54 was qcow2, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 04:47:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:13 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:47:13 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:14 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:14 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:47:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:14 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 Jun 12 04:47:14 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:14 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29" returned: 0 in 0.626s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:15 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info Jun 12 04:47:15 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:15 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info" returned: 0 in 0.689s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:15 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:47:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:15 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info Jun 12 04:47:15 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:15 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 1.916s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:15 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_hs3q9d87devstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:47:15 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Converted 112.00 MB image at 58.35 MB/s Jun 12 04:47:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:15 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e 1G Jun 12 04:47:15 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:16 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.info" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.321s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Creating offline snapshot eca4fee3-9b77-463d-8e4d-9fe14ce2a461 of volume b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dcf0db-d778-4010-b2e3-cedce8c32585]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:16 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a Jun 12 04:47:16 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:16 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e 1G" returned: 0 in 0.650s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[71de5924-e090-4ca4-955a-22657ad9d469]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:16 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:47:16 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:17 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" returned: 0 in 0.732s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:17 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 1G Jun 12 04:47:17 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:17 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 0.756s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:17 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:47:17 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:17 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 1G" returned: 0 in 0.908s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:18 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 Jun 12 04:47:18 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:18 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 1 in 0.941s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Downloaded image 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume e92d26d2-2d6c-407a-8f84-1882f9368b4e successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 for user b4bfa7a970df4192b642b6b0ce5a43f8 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Marking volume e92d26d2-2d6c-407a-8f84-1882f9368b4e as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Copying metadata from image 23fce906-aa03-46a6-9408-5b9570e89c54 to e92d26d2-2d6c-407a-8f84-1882f9368b4e. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Creating volume glance metadata for volume e92d26d2-2d6c-407a-8f84-1882f9368b4e backed by image 23fce906-aa03-46a6-9408-5b9570e89c54 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce0a8e3-d8e4-4b7f-9816-93d504d804b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c16ca8-0b15-4554-aef7-84e81ae293f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:18 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Volume volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e (e92d26d2-2d6c-407a-8f84-1882f9368b4e): created successfully Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c16ca8-0b15-4554-aef7-84e81ae293f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Flow 'volume_create_manager' (2a5d3b65-635e-4fd3-9e23-e2382ac45598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-27dbe41b-3289-41b6-9a03-9d476cda67fc tempest-TestShelveInstance-531523193 None] Created volume successfully. Jun 12 04:47:18 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461" returned: 0 in 0.824s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:18 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:47:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:18 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 Jun 12 04:47:18 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:19 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:19 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info Jun 12 04:47:19 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:20 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:20 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:47:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:20 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info Jun 12 04:47:20 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:20 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.info" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.576s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5fb9a87b-1324-4fff-90b1-a72ee0cf5f9f tempest-GroupSnapshotsTest-2116745330 None] group_snapshot e9d48fc6-fea1-425b-9fa6-747a771622b3: created successfully Jun 12 04:47:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot e9d48fc6-fea1-425b-9fa6-747a771622b3: deleting Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot e9d48fc6-fea1-425b-9fa6-747a771622b3: deleting {{(pid=92320) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4362}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-c68e2102-4397-4312-9d94-b6c1bc64bbcd" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-c68e2102-4397-4312-9d94-b6c1bc64bbcd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-b937846b-494b-412b-9c53-f26c84122b29" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-b937846b-494b-412b-9c53-f26c84122b29" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Deleting offline snapshot b937846b-494b-412b-9c53-f26c84122b29 of volume c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] snapshot_file for this snap is: volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830147a-c20a-4b4f-8677-d91e253ba72b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:21 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 Jun 12 04:47:21 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:22 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29" returned: 0 in 0.719s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:47:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5665f43-a38e-40ed-8eb4-0cd55539850f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:22 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd Jun 12 04:47:22 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:23 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd" returned: 0 in 0.717s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:23 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 Jun 12 04:47:23 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:23 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29" returned: 0 in 0.697s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:23 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29 Jun 12 04:47:23 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:24 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd.b937846b-494b-412b-9c53-f26c84122b29" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-b937846b-494b-412b-9c53-f26c84122b29" released by "_delete_snapshot" :: held 2.807s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-c68e2102-4397-4312-9d94-b6c1bc64bbcd" released by "delete_snapshot" :: held 2.837s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-eca4fee3-9b77-463d-8e4d-9fe14ce2a461" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-eca4fee3-9b77-463d-8e4d-9fe14ce2a461" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Deleting offline snapshot eca4fee3-9b77-463d-8e4d-9fe14ce2a461 of volume b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] snapshot_file for this snap is: volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4795168d-48df-4d42-a62c-2a30aae8d52d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:24 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 Jun 12 04:47:24 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:25 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461" returned: 0 in 1.217s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:47:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb533900-ab9a-4848-bd34-b8e19d21a0e4]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:26 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a Jun 12 04:47:26 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:27 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9ffdc-7abd-4d57-9795-dacec1dbbbe9]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:27 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:47:27 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:27 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" returned: 0 in 1.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:27 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 Jun 12 04:47:27 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:28 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 1.309s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:28 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:47:28 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:29 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461" returned: 0 in 1.497s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:29 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461 Jun 12 04:47:29 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:29 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 1 in 0.963s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:47:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.395s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '974c7815-6410-4d8a-a49b-85ee88704dcd', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:47:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-5ac18c9f-267c-4a55-bd6a-e94e1d0b54f2 req-70a88efd-64e8-4f00-be1a-33ae25dc8711 tempest-TestShelveInstance-531523193 None] attachment_update completed successfully. Jun 12 04:47:30 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a.eca4fee3-9b77-463d-8e4d-9fe14ce2a461" returned: 0 in 0.862s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-eca4fee3-9b77-463d-8e4d-9fe14ce2a461" released by "_delete_snapshot" :: held 5.393s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" released by "delete_snapshot" :: held 5.436s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:30 devstack cinder-volume[92320]: WARNING cinder.quota [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1403059469 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1403059469, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:47:30 devstack cinder-volume[92320]: WARNING cinder.quota [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1403059469 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1403059469, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['385fad58-1e84-43ab-a532-114353ba4276', '1e327554-438a-4f13-a083-a8aca1360461', '9aa48a94-6e29-443c-910a-b78cfb4d072c', '3c4db3bd-ed48-4169-b552-b0bebfd47bd0'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['d2b498c0-118e-4993-97a1-f6985d22502e', '3559f6a2-d4dc-4680-8b5e-f54c69a81619', '3b89be01-1c47-4767-b582-1c30ba748116', '27684187-7a79-4680-b0ec-e7dde50ab82c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-57fc3252-f871-4024-b30b-7fbea78e1201 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot e9d48fc6-fea1-425b-9fa6-747a771622b3: deleted successfully Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24b36e3-606e-45b2-a166-b9fa3e282123]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:31 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a Jun 12 04:47:31 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:31 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:47:31 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:31 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" returned: 0 in 0.849s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:31 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a Jun 12 04:47:31 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:32 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.960s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:47:32 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" returned: 0 in 1.052s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-b6cf6483-f1b7-43ce-b6e1-83654aaa6a1a" released by "delete_volume" :: held 2.002s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-c68e2102-4397-4312-9d94-b6c1bc64bbcd" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-c68e2102-4397-4312-9d94-b6c1bc64bbcd" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b3354c-f665-4475-bfbe-62c6876bd702]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:33 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd Jun 12 04:47:33 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:33 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd" returned: 0 in 0.807s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:33 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd Jun 12 04:47:33 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:34 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c68e2102-4397-4312-9d94-b6c1bc64bbcd" returned: 0 in 0.670s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-c68e2102-4397-4312-9d94-b6c1bc64bbcd" released by "delete_volume" :: held 1.533s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['0f2242ff-45d2-47f7-9afa-1d21a3ac18a8'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:34 devstack cinder-volume[92320]: WARNING cinder.quota [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1403059469 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1403059469, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['dd428a25-328f-456c-9bb2-8ce5d3d4783c', '587cdc30-d2b4-42d8-8d4e-fcb0e7523850', '645d2218-73ae-4153-847b-5d396c292daf', '35d7d881-be61-437d-a916-32a4e450f2f4'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['6b1eb421-c49a-4b22-bcf1-16905cd36378', '798d9fa4-2d7b-4e9f-a15b-65d6e0ca33d0', 'dce525fa-ea8a-4e2c-a5b0-54f7ee2e85d6', '066bc2d0-140a-417a-a4cb-3b7f267b38c0'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:34 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:47:34 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:35 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.948s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:35 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:47:35 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-73c0d122-8f84-4520-a163-cc8de73a8f4d tempest-GroupSnapshotsTest-2116745330 None] Delete group completed successfully. Jun 12 04:47:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a651a320-279e-4dec-a58a-36237e289110 tempest-GroupSnapshotsTest-2116745330 None] Group tempest-GroupSnapshotsTest-Group-1979019822: creating Jun 12 04:47:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a651a320-279e-4dec-a58a-36237e289110 tempest-GroupSnapshotsTest-2116745330 None] Group tempest-GroupSnapshotsTest-Group-1979019822: created successfully Jun 12 04:47:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a651a320-279e-4dec-a58a-36237e289110 tempest-GroupSnapshotsTest-2116745330 None] Create group completed successfully. Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (d568b6d0-4326-4665-a45c-1bfa0ff4c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1929aab-9d5b-4a08-bca1-8b4184ae855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1929aab-9d5b-4a08-bca1-8b4184ae855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455520976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30b367f6-bc71-454d-9e73-167106df5a9b,host='devstack@QuobyteHD#QuobyteHD',id=0e71ade8-b0e3-486f-abc9-4db24b916608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:38Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3b22ed4-1109-456c-a68f-cde33c437d20),volume_type_id=b3b22ed4-1109-456c-a68f-cde33c437d20)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9e1f4f-3bad-4204-a0d4-f5ce4c1d2411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9e1f4f-3bad-4204-a0d4-f5ce4c1d2411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1fd325-e5de-43ff-99e2-449f91119fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1fd325-e5de-43ff-99e2-449f91119fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e71ade8-b0e3-486f-abc9-4db24b916608', 'volume_name': 'volume-0e71ade8-b0e3-486f-abc9-4db24b916608', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55c122f-2570-4823-b30d-8927b7b0396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55c122f-2570-4823-b30d-8927b7b0396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664eaf14-8201-45b6-ba42-e5b2acae91cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Volume 0e71ade8-b0e3-486f-abc9-4db24b916608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e71ade8-b0e3-486f-abc9-4db24b916608', 'volume_size': 1} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30b367f6-bc71-454d-9e73-167106df5a9b,created_at=2026-06-12T02:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455520976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30b367f6-bc71-454d-9e73-167106df5a9b,host='devstack@QuobyteHD#QuobyteHD',id=0e71ade8-b0e3-486f-abc9-4db24b916608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557a38677c4847aabd1600fe2dafdce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:38Z,use_quota=True,user_id='34d59912380240a78d0098f69368cde4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3b22ed4-1109-456c-a68f-cde33c437d20),volume_type_id=b3b22ed4-1109-456c-a68f-cde33c437d20)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Creating volume 0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:47:38 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:47:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:38 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 1073741824 Jun 12 04:47:38 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:39 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 1073741824" returned: 0 in 1.137s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:39 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 Jun 12 04:47:39 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:40 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608" returned: 0 in 0.670s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664eaf14-8201-45b6-ba42-e5b2acae91cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e71ade8-b0e3-486f-abc9-4db24b916608', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229e95b8-8cf2-4800-b805-e748a8534070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Volume volume-0e71ade8-b0e3-486f-abc9-4db24b916608 (0e71ade8-b0e3-486f-abc9-4db24b916608): created successfully Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229e95b8-8cf2-4800-b805-e748a8534070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Flow 'volume_create_manager' (d568b6d0-4326-4665-a45c-1bfa0ff4c37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-062aa96e-f4cd-4363-a882-090b37b5f5a8 tempest-GroupSnapshotsTest-2116745330 None] Created volume successfully. Jun 12 04:47:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] GroupSnapshot a39611e7-2993-4783-bb7a-8fc476101c23: creating. Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Group snapshot a39611e7-2993-4783-bb7a-8fc476101c23: creating. {{(pid=92320) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4187}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Creating offline snapshot 3c21645f-f070-455a-8aec-f193a9e68710 of volume 0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23958d1-2cb0-45f5-ba6d-c3301677b8a2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:41 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 Jun 12 04:47:41 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:41 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608" returned: 0 in 0.825s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:41 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 1G Jun 12 04:47:41 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:42 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 1G" returned: 0 in 0.874s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e71ade8-b0e3-486f-abc9-4db24b916608 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:42 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e71ade8-b0e3-486f-abc9-4db24b916608 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 Jun 12 04:47:42 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:43 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e71ade8-b0e3-486f-abc9-4db24b916608 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:43 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:47:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:43 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 Jun 12 04:47:43 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:43 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:44 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info Jun 12 04:47:44 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:44 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info" returned: 0 in 0.616s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:44 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:47:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:44 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info Jun 12 04:47:44 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:45 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.info" returned: 0 in 0.605s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.335s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cf8eb312-f42a-494a-a493-1d679145bc54 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot a39611e7-2993-4783-bb7a-8fc476101c23: created successfully Jun 12 04:47:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot a39611e7-2993-4783-bb7a-8fc476101c23: deleting Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot a39611e7-2993-4783-bb7a-8fc476101c23: deleting {{(pid=92320) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4362}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-0e71ade8-b0e3-486f-abc9-4db24b916608" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-0e71ade8-b0e3-486f-abc9-4db24b916608" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-3c21645f-f070-455a-8aec-f193a9e68710" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-3c21645f-f070-455a-8aec-f193a9e68710" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Deleting offline snapshot 3c21645f-f070-455a-8aec-f193a9e68710 of volume 0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] snapshot_file for this snap is: volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[86235d80-960d-4a3a-82c1-7e9e02a44697]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:46 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 Jun 12 04:47:46 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:47 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710" returned: 0 in 0.819s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e71ade8-b0e3-486f-abc9-4db24b916608(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:47:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be49cc2-da88-4baa-928a-c5886ab3018a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:47 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 Jun 12 04:47:47 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:48 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608" returned: 0 in 0.747s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:48 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 Jun 12 04:47:48 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:48 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710" returned: 0 in 0.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:48 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710 Jun 12 04:47:48 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:49 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608.3c21645f-f070-455a-8aec-f193a9e68710" returned: 0 in 0.602s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-3c21645f-f070-455a-8aec-f193a9e68710" released by "_delete_snapshot" :: held 2.947s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-0e71ade8-b0e3-486f-abc9-4db24b916608" released by "delete_snapshot" :: held 2.982s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=92,cinder:SELECT=102,cinder:INSERT=25,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=81,cinder:SELECT=103,cinder:INSERT=26,cinder:DELETE=3 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:47:49 devstack cinder-volume[92320]: WARNING cinder.quota [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-25144539 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-25144539, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:47:49 devstack cinder-volume[92320]: WARNING cinder.quota [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-25144539 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-25144539, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['44ccb144-9318-469a-a32c-f50a9981ad1f', 'bd4c8ef1-5f35-4239-9bc0-020bf8fe871e', '0fbbe1de-08f9-4a14-a298-909c63dca5e4', '0873574f-742b-442b-8c03-683b88baec30'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2bd9c66a-34f9-4d2a-b696-cd70fe006e51 tempest-GroupSnapshotsTest-2116745330 None] group_snapshot a39611e7-2993-4783-bb7a-8fc476101c23: deleted successfully Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "cinder-quobyte-0e71ade8-b0e3-486f-abc9-4db24b916608" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:47:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-0e71ade8-b0e3-486f-abc9-4db24b916608" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4d80de-3317-4543-b3a5-1ad2edfa61ff]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:50 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 Jun 12 04:47:50 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Flow 'volume_create_manager' (580b1e93-1c53-4ce6-b8ab-efae9d6dc17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92478d1e-d420-4894-a050-6e0dbfefa8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92478d1e-d420-4894-a050-6e0dbfefa8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-906769450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f235c3ac-ff11-45fa-b4c1-4ec070fbd412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb88db0f23741b59b381b3573707cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:51Z,use_quota=True,user_id='88c89bcb129641e8977574c702dcbb03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25490359-f9a4-446b-a007-36ec32c19361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25490359-f9a4-446b-a007-36ec32c19361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ea541f-fa8c-4ce6-825e-afcaa5fd8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ea541f-fa8c-4ce6-825e-afcaa5fd8687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f235c3ac-ff11-45fa-b4c1-4ec070fbd412', 'volume_name': 'volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b7bcc8-5829-4f24-b598-be4771ffffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b7bcc8-5829-4f24-b598-be4771ffffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9ebed6-0e49-49f8-b75f-c14e1bcfdf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:50 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Volume f235c3ac-ff11-45fa-b4c1-4ec070fbd412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412', 'volume_size': 1} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-906769450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f235c3ac-ff11-45fa-b4c1-4ec070fbd412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb88db0f23741b59b381b3573707cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:47:51Z,use_quota=True,user_id='88c89bcb129641e8977574c702dcbb03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Creating volume f235c3ac-ff11-45fa-b4c1-4ec070fbd412 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:47:50 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:50 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608" returned: 0 in 0.829s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:50 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 1073741824 Jun 12 04:47:50 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:50 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608 Jun 12 04:47:50 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:51 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0e71ade8-b0e3-486f-abc9-4db24b916608" returned: 0 in 0.638s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Lock "cinder-quobyte-0e71ade8-b0e3-486f-abc9-4db24b916608" released by "delete_volume" :: held 1.543s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['d96358db-c1db-460f-98f8-ac78753608ba'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:51 devstack cinder-volume[92320]: WARNING cinder.quota [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-25144539 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-25144539, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Created reservations ['ee86e65a-4ac7-41f9-93a8-9b8f1beafea3', '461bbf7f-3e3b-4ff8-9008-485f5b333b01', '391de6dc-29f5-418d-a699-23f8cf0fb5d6', '8b56b810-6ce1-4b39-96d2-dcf44526f902'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:47:51 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 1073741824" returned: 0 in 0.841s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:51 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 Jun 12 04:47:51 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:51 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:47:51 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:52 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" returned: 0 in 0.749s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9ebed6-0e49-49f8-b75f-c14e1bcfdf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da9e4e9-2989-41d8-9c3a-2b54e945f2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:47:52 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Volume volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 (f235c3ac-ff11-45fa-b4c1-4ec070fbd412): created successfully Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da9e4e9-2989-41d8-9c3a-2b54e945f2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Flow 'volume_create_manager' (580b1e93-1c53-4ce6-b8ab-efae9d6dc17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:47:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cffd3ccd-b8e3-48d6-b842-0740edbf74e0 tempest-AttachVolumeTestJSON-732787644 None] Created volume successfully. Jun 12 04:47:52 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.776s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:52 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:47:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-78f43607-4f5a-4d19-93cb-67bc43f7e79c tempest-GroupSnapshotsTest-2116745330 None] Delete group completed successfully. Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bc197b-a83c-4664-99d6-19b78ce73f57]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:47:56 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 Jun 12 04:47:56 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:47:56 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" returned: 0 in 0.729s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.750s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:47:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b5953d4-ffa6-445e-beb1-3775120abcb9', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:47:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-9bb442a9-6f31-4ff3-8509-47e8af04f302 req-ed94b548-9f38-4a6c-8ce5-4cbf298034e7 tempest-AttachVolumeTestJSON-732787644 None] attachment_update completed successfully. Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Flow 'volume_create_manager' (18ca140b-08fd-409f-a8f4-3c862054f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08023d9b-e463-40b7-90a4-64130567d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08023d9b-e463-40b7-90a4-64130567d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1584169015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa60d23-a29b-4064-a62d-2478d38cd711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb88db0f23741b59b381b3573707cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:02Z,use_quota=True,user_id='88c89bcb129641e8977574c702dcbb03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f5db96-24e7-4472-83ca-2cb14373bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f5db96-24e7-4472-83ca-2cb14373bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314d2de9-20f1-4838-bba0-b87855321712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314d2de9-20f1-4838-bba0-b87855321712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa60d23-a29b-4064-a62d-2478d38cd711', 'volume_name': 'volume-3aa60d23-a29b-4064-a62d-2478d38cd711', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f326c9-9228-4faf-b086-6d0a8d1b74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f326c9-9228-4faf-b086-6d0a8d1b74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3674193-d837-4ed4-a799-a9a900f7a452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:01 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Volume 3aa60d23-a29b-4064-a62d-2478d38cd711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa60d23-a29b-4064-a62d-2478d38cd711', 'volume_size': 1} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1584169015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa60d23-a29b-4064-a62d-2478d38cd711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb88db0f23741b59b381b3573707cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:02Z,use_quota=True,user_id='88c89bcb129641e8977574c702dcbb03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Creating volume 3aa60d23-a29b-4064-a62d-2478d38cd711 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:48:01 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:48:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:02 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 1073741824 Jun 12 04:48:02 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-80b8e34c-0bc1-4428-834e-ea2c873868ad tempest-GroupsTest-264206960 None] Group tempest-Group1-2061380768: creating Jun 12 04:48:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-80b8e34c-0bc1-4428-834e-ea2c873868ad tempest-GroupsTest-264206960 None] Group tempest-Group1-2061380768: created successfully Jun 12 04:48:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-80b8e34c-0bc1-4428-834e-ea2c873868ad tempest-GroupsTest-264206960 None] Create group completed successfully. Jun 12 04:48:02 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 1073741824" returned: 0 in 0.986s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:03 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 Jun 12 04:48:03 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:03 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711" returned: 0 in 0.650s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3674193-d837-4ed4-a799-a9a900f7a452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa60d23-a29b-4064-a62d-2478d38cd711', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617691d1-f5f1-40e2-bef5-0dc4e66e2f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:03 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Volume volume-3aa60d23-a29b-4064-a62d-2478d38cd711 (3aa60d23-a29b-4064-a62d-2478d38cd711): created successfully Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617691d1-f5f1-40e2-bef5-0dc4e66e2f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Flow 'volume_create_manager' (18ca140b-08fd-409f-a8f4-3c862054f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-37cad541-53b9-4eab-8983-3d9acec7cd4e tempest-AttachVolumeTestJSON-732787644 None] Created volume successfully. Jun 12 04:48:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3fffd183-22ce-437c-aae1-26cce959a7c2 tempest-GroupsTest-264206960 None] Group tempest-Group2-1108324312: creating Jun 12 04:48:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3fffd183-22ce-437c-aae1-26cce959a7c2 tempest-GroupsTest-264206960 None] Group tempest-Group2-1108324312: created successfully Jun 12 04:48:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3fffd183-22ce-437c-aae1-26cce959a7c2 tempest-GroupsTest-264206960 None] Create group completed successfully. Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Flow 'volume_create_manager' (ca2cecb3-4afb-4712-8a98-774ed3071f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4014d145-d8ed-445b-ac26-a1220cd3a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4014d145-d8ed-445b-ac26-a1220cd3a646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1932459153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ca025e4-93cb-4133-9f36-66f3da1f57bb,host='devstack@QuobyteHD#QuobyteHD',id=a44182f5-fb14-4829-86cc-fcffeb101861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2726e3a60449a0ac1427425e60e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:05Z,use_quota=True,user_id='853b81d3f93c40b09e75ee4ab33f964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f67507f-3680-4d02-afb5-fa3d93c02fd4),volume_type_id=9f67507f-3680-4d02-afb5-fa3d93c02fd4)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba16dab1-aa80-4afb-b5fb-10eb9e812673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba16dab1-aa80-4afb-b5fb-10eb9e812673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0f18c7-f459-4560-9ace-1c1cbd682392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0f18c7-f459-4560-9ace-1c1cbd682392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44182f5-fb14-4829-86cc-fcffeb101861', 'volume_name': 'volume-a44182f5-fb14-4829-86cc-fcffeb101861', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4724bb2-675c-4835-952e-57480ec37d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4724bb2-675c-4835-952e-57480ec37d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57524cda-5837-4782-aa50-4fe246099ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Volume a44182f5-fb14-4829-86cc-fcffeb101861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44182f5-fb14-4829-86cc-fcffeb101861', 'volume_size': 1} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ca025e4-93cb-4133-9f36-66f3da1f57bb,created_at=2026-06-12T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1932459153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ca025e4-93cb-4133-9f36-66f3da1f57bb,host='devstack@QuobyteHD#QuobyteHD',id=a44182f5-fb14-4829-86cc-fcffeb101861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2726e3a60449a0ac1427425e60e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:05Z,use_quota=True,user_id='853b81d3f93c40b09e75ee4ab33f964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f67507f-3680-4d02-afb5-fa3d93c02fd4),volume_type_id=9f67507f-3680-4d02-afb5-fa3d93c02fd4)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Creating volume a44182f5-fb14-4829-86cc-fcffeb101861 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:48:05 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:48:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:05 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 1073741824 Jun 12 04:48:05 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:06 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 1073741824" returned: 0 in 0.992s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:06 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 Jun 12 04:48:06 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:07 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57524cda-5837-4782-aa50-4fe246099ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44182f5-fb14-4829-86cc-fcffeb101861', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ed256a-d71d-4c63-ab2e-f4007abdbd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff24645f-7134-4cb4-a56a-d2ddcf0aab9e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:07 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Volume volume-a44182f5-fb14-4829-86cc-fcffeb101861 (a44182f5-fb14-4829-86cc-fcffeb101861): created successfully Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ed256a-d71d-4c63-ab2e-f4007abdbd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Flow 'volume_create_manager' (ca2cecb3-4afb-4712-8a98-774ed3071f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6470d875-5bb3-4ba0-a1d9-48338c44b66b tempest-GroupsTest-264206960 None] Created volume successfully. Jun 12 04:48:07 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 Jun 12 04:48:07 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:08 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711" returned: 0 in 0.822s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Acquiring lock "cinder-quobyte-a44182f5-fb14-4829-86cc-fcffeb101861" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Lock "cinder-quobyte-a44182f5-fb14-4829-86cc-fcffeb101861" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb0261-ffc7-4b34-8da7-f589efb03a9b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-3aa60d23-a29b-4064-a62d-2478d38cd711', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd89e9fa-3c59-43cb-9301-b4047664fee7', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:48:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-ae885ea0-49a9-4fdb-91bd-909a51167fe2 req-be9735fe-d5ca-4e8d-873e-4c3b4dde47b5 tempest-AttachVolumeTestJSON-732787644 None] attachment_update completed successfully. Jun 12 04:48:08 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 Jun 12 04:48:08 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:09 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861" returned: 0 in 0.822s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-277d9527-35b2-4fb6-a8a8-4b04b85722b4 req-00dfe2e4-4dfe-42ed-8219-a8aba43596ad tempest-TestShelveInstance-531523193 None] Terminate volume connection completed successfully. Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-277d9527-35b2-4fb6-a8a8-4b04b85722b4 req-00dfe2e4-4dfe-42ed-8219-a8aba43596ad tempest-TestShelveInstance-531523193 None] Deleting attachment 974c7815-6410-4d8a-a49b-85ee88704dcd. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:48:09 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861 Jun 12 04:48:09 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:09 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a44182f5-fb14-4829-86cc-fcffeb101861" returned: 0 in 0.684s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Lock "cinder-quobyte-a44182f5-fb14-4829-86cc-fcffeb101861" released by "delete_volume" :: held 1.550s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Created reservations ['3a80139e-0177-4d6b-b515-3d538e9b13e5'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:09 devstack cinder-volume[92320]: WARNING cinder.quota [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-699036135 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-699036135, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:48:09 devstack cinder-volume[92320]: WARNING cinder.quota [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-699036135 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-699036135, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:48:09 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Created reservations ['6ee2b37d-2a69-41a8-9cd1-9a408e29d084', '7bef1f28-d205-4ae3-80ab-d538bc480fa9', '394d3801-d66a-495f-b283-69d63b324c7d', '5d965b42-9403-436a-ac39-4f2aeb3bea30'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:10 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:10 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:10 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.653s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:10 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ecd07922-6347-4bd5-b193-af1f534cd6ff tempest-GroupsTest-264206960 None] Delete group completed successfully. Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Created reservations ['5069c41c-8fc3-4557-8103-378de4f7414b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:10 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:10 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:11 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.659s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:11 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4a20b579-e191-4213-a38e-0bca8443d4b4 tempest-GroupsTest-264206960 None] Delete group completed successfully. Jun 12 04:48:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e9ac6476-a165-4772-9fdd-c05e133bfbe9 tempest-GroupsTest-264206960 None] Group tempest-GroupsTest-Group-912118216: creating Jun 12 04:48:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e9ac6476-a165-4772-9fdd-c05e133bfbe9 tempest-GroupsTest-264206960 None] Group tempest-GroupsTest-Group-912118216: created successfully Jun 12 04:48:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e9ac6476-a165-4772-9fdd-c05e133bfbe9 tempest-GroupsTest-264206960 None] Create group completed successfully. Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Flow 'volume_create_manager' (bcf56c3b-6594-4365-bac6-82104c3d7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a5646-92da-4413-b788-7715a5dd5bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a5646-92da-4413-b788-7715a5dd5bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596681437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d2c5d6-ed54-44ed-be77-a212266328b9,host='devstack@QuobyteHD#QuobyteHD',id=789b18fa-40e4-4b3b-be32-d5010d29bba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2726e3a60449a0ac1427425e60e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:14Z,use_quota=True,user_id='853b81d3f93c40b09e75ee4ab33f964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bffecff2-ce8b-47ea-836c-fc8778ef34a5),volume_type_id=bffecff2-ce8b-47ea-836c-fc8778ef34a5)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1b7c23-bc3b-43d7-96fe-f534c2c3ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1b7c23-bc3b-43d7-96fe-f534c2c3ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69598e2a-ca2b-43be-965c-ef13e1e56aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69598e2a-ca2b-43be-965c-ef13e1e56aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789b18fa-40e4-4b3b-be32-d5010d29bba8', 'volume_name': 'volume-789b18fa-40e4-4b3b-be32-d5010d29bba8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08854ab-479d-4275-8480-a0a5be16b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08854ab-479d-4275-8480-a0a5be16b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4678ad7-4f8c-46e1-8c9c-c7192094bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:14 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Volume 789b18fa-40e4-4b3b-be32-d5010d29bba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789b18fa-40e4-4b3b-be32-d5010d29bba8', 'volume_size': 1} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06d2c5d6-ed54-44ed-be77-a212266328b9,created_at=2026-06-12T02:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596681437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d2c5d6-ed54-44ed-be77-a212266328b9,host='devstack@QuobyteHD#QuobyteHD',id=789b18fa-40e4-4b3b-be32-d5010d29bba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2726e3a60449a0ac1427425e60e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:14Z,use_quota=True,user_id='853b81d3f93c40b09e75ee4ab33f964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bffecff2-ce8b-47ea-836c-fc8778ef34a5),volume_type_id=bffecff2-ce8b-47ea-836c-fc8778ef34a5)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Creating volume 789b18fa-40e4-4b3b-be32-d5010d29bba8 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:48:14 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:14 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 1073741824 Jun 12 04:48:14 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:14 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 1073741824" returned: 0 in 0.812s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:14 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 Jun 12 04:48:14 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-6af65efb-9d8d-4ee1-ba17-8dc47b31199e req-625bdbbc-b887-4d02-adde-d9e839068775 tempest-AttachVolumeTestJSON-732787644 None] Terminate volume connection completed successfully. Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6af65efb-9d8d-4ee1-ba17-8dc47b31199e req-625bdbbc-b887-4d02-adde-d9e839068775 tempest-AttachVolumeTestJSON-732787644 None] Deleting attachment 2b5953d4-ffa6-445e-beb1-3775120abcb9. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:48:15 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8" returned: 0 in 0.639s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.164s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4678ad7-4f8c-46e1-8c9c-c7192094bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789b18fa-40e4-4b3b-be32-d5010d29bba8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee9aaac-041e-4064-8eba-8b43124da77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a813e-e130-4e2d-bec8-8c3d74d1fa45]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:15 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Volume volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 (789b18fa-40e4-4b3b-be32-d5010d29bba8): created successfully Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee9aaac-041e-4064-8eba-8b43124da77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:15 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Flow 'volume_create_manager' (bcf56c3b-6594-4365-bac6-82104c3d7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9e3e4c68-4176-48ed-9b91-4fd9880b7b6f tempest-GroupsTest-264206960 None] Created volume successfully. Jun 12 04:48:15 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:48:15 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:16 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 0.782s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:16 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:48:16 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Flow 'volume_create_manager' (c9cebc78-5705-47f6-bdee-790023ce7c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8802bb-398a-4ae4-a071-dcb04827d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8802bb-398a-4ae4-a071-dcb04827d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1324332226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d2c5d6-ed54-44ed-be77-a212266328b9,host='devstack@QuobyteHD#QuobyteHD',id=3cb6242f-240b-44da-b4c5-cbafd997be1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2726e3a60449a0ac1427425e60e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:17Z,use_quota=True,user_id='853b81d3f93c40b09e75ee4ab33f964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bffecff2-ce8b-47ea-836c-fc8778ef34a5),volume_type_id=bffecff2-ce8b-47ea-836c-fc8778ef34a5)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3f3e78-5ba1-45d6-be2b-8ffb517b4dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3f3e78-5ba1-45d6-be2b-8ffb517b4dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0762b4-ee19-41cb-9887-2059caa0dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0762b4-ee19-41cb-9887-2059caa0dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb6242f-240b-44da-b4c5-cbafd997be1c', 'volume_name': 'volume-3cb6242f-240b-44da-b4c5-cbafd997be1c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfed76b-3f7c-42ca-8886-6b96c05efc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfed76b-3f7c-42ca-8886-6b96c05efc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91a9a7d-9c5f-4dd5-9aa6-3463c3b31155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:16 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Volume 3cb6242f-240b-44da-b4c5-cbafd997be1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb6242f-240b-44da-b4c5-cbafd997be1c', 'volume_size': 1} Jun 12 04:48:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:17 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 1 in 0.718s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.542s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06d2c5d6-ed54-44ed-be77-a212266328b9,created_at=2026-06-12T02:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1324332226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d2c5d6-ed54-44ed-be77-a212266328b9,host='devstack@QuobyteHD#QuobyteHD',id=3cb6242f-240b-44da-b4c5-cbafd997be1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2726e3a60449a0ac1427425e60e165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:17Z,use_quota=True,user_id='853b81d3f93c40b09e75ee4ab33f964c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bffecff2-ce8b-47ea-836c-fc8778ef34a5),volume_type_id=bffecff2-ce8b-47ea-836c-fc8778ef34a5)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Creating volume 3cb6242f-240b-44da-b4c5-cbafd997be1c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:48:17 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:17 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c 1073741824 Jun 12 04:48:17 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfb8c916-004c-41e9-b136-510776a0fc26', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:48:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-b9b50189-fa28-4503-8e6d-a175bc4d23a2 req-9050a04d-be3f-40a8-b73a-9766270aff4c tempest-TestShelveInstance-531523193 None] attachment_update completed successfully. Jun 12 04:48:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-b0fe2ed9-09e5-434c-9174-f27699717147 req-76060498-c459-4cb7-90ed-a3cf6b3ecc35 tempest-AttachVolumeTestJSON-732787644 None] Terminate volume connection completed successfully. Jun 12 04:48:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-b0fe2ed9-09e5-434c-9174-f27699717147 req-76060498-c459-4cb7-90ed-a3cf6b3ecc35 tempest-AttachVolumeTestJSON-732787644 None] Deleting attachment bd89e9fa-3c59-43cb-9301-b4047664fee7. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:48:18 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c 1073741824" returned: 0 in 0.918s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:18 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c Jun 12 04:48:18 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:18 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91a9a7d-9c5f-4dd5-9aa6-3463c3b31155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb6242f-240b-44da-b4c5-cbafd997be1c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de84f628-4f29-4a1b-a5b5-53dc2bb6d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:18 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Volume volume-3cb6242f-240b-44da-b4c5-cbafd997be1c (3cb6242f-240b-44da-b4c5-cbafd997be1c): created successfully Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de84f628-4f29-4a1b-a5b5-53dc2bb6d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Flow 'volume_create_manager' (c9cebc78-5705-47f6-bdee-790023ce7c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b78782d3-8773-49aa-a77a-80c3897e53ec tempest-GroupsTest-264206960 None] Created volume successfully. Jun 12 04:48:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b373bf61-5a49-4d44-990b-06cfdf58ade5 tempest-GroupsTest-264206960 None] Update group completed successfully. Jun 12 04:48:20 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-466e9ca9-bfa6-40a2-8f0b-1f34ce9ee3f5 tempest-GroupsTest-264206960 None] Update group completed successfully. Jun 12 04:48:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Acquiring lock "cinder-quobyte-3cb6242f-240b-44da-b4c5-cbafd997be1c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Lock "cinder-quobyte-3cb6242f-240b-44da-b4c5-cbafd997be1c" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:21 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[87850dcb-2cfa-4e94-8932-cfea60807f7f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:22 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c Jun 12 04:48:22 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:22 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c" returned: 0 in 0.816s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:22 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c Jun 12 04:48:22 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:23 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3cb6242f-240b-44da-b4c5-cbafd997be1c" returned: 0 in 0.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Lock "cinder-quobyte-3cb6242f-240b-44da-b4c5-cbafd997be1c" released by "delete_volume" :: held 1.475s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Acquiring lock "cinder-quobyte-789b18fa-40e4-4b3b-be32-d5010d29bba8" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Lock "cinder-quobyte-789b18fa-40e4-4b3b-be32-d5010d29bba8" acquired by "delete_volume" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:23 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ab53b-973e-4f04-acec-ea5c257614af]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:23 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 Jun 12 04:48:23 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:24 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8" returned: 0 in 0.704s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:24 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8 Jun 12 04:48:24 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:24 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-789b18fa-40e4-4b3b-be32-d5010d29bba8" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Lock "cinder-quobyte-789b18fa-40e4-4b3b-be32-d5010d29bba8" released by "delete_volume" :: held 1.390s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:24 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Created reservations ['20c17391-eff9-4d9c-96b8-f2fcd5497143'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:24 devstack cinder-volume[92320]: WARNING cinder.quota [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-986831620 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-986831620, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:48:24 devstack cinder-volume[92320]: WARNING cinder.quota [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-986831620 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-986831620, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:48:24 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Created reservations ['7ba29ced-fe40-45c6-82bd-2b04a4239c61', 'db133bd8-c394-4090-9695-f08414c5672b', 'a130472c-5ebf-404a-bd5f-878883219c3a', 'c6852e91-3db5-45f9-84a5-e12bdadf7b7f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Created reservations ['7d226ba4-7a01-402c-b53a-98ea3502f5a3', '25f89089-8208-42e3-9ba6-1b537440ede0', '73a86e55-fe14-4f4f-b1b1-074eea46039e', '76cc5a38-8447-4945-a939-3d7d78a77f6d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:25 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:25 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:25 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.694s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:25 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:25 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-61452060-9082-4a87-ab2d-e291ebe05fab tempest-GroupsTest-264206960 None] Delete group completed successfully. Jun 12 04:48:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "cinder-3aa60d23-a29b-4064-a62d-2478d38cd711-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-3aa60d23-a29b-4064-a62d-2478d38cd711-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "cinder-quobyte-3aa60d23-a29b-4064-a62d-2478d38cd711" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-quobyte-3aa60d23-a29b-4064-a62d-2478d38cd711" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc3751b-4479-40d6-b00b-c4d196809ba2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:29 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 Jun 12 04:48:29 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:30 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711" returned: 0 in 0.877s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:30 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711 Jun 12 04:48:30 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:30 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3aa60d23-a29b-4064-a62d-2478d38cd711" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-quobyte-3aa60d23-a29b-4064-a62d-2478d38cd711" released by "delete_volume" :: held 1.722s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Created reservations ['d9362260-873d-4781-b57b-2b6ab642cead', 'a9d492da-5e97-4e33-abcd-dd9bc289b308', '801d2000-4ce0-46ba-b77e-319a8081f53a', '5c6f0298-c575-4935-9eb6-3e62d83f79da'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:31 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:31 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "cinder-f235c3ac-ff11-45fa-b4c1-4ec070fbd412-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-f235c3ac-ff11-45fa-b4c1-4ec070fbd412-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "cinder-quobyte-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-quobyte-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb6970-c5aa-4f00-99a9-f0c1fac18d01]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:31 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:31 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:32 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.960s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:32 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 Jun 12 04:48:32 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:32 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Deleted volume successfully. Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0bd07259-f381-4797-a96f-6ee969441b66 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-3aa60d23-a29b-4064-a62d-2478d38cd711-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:32 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.924s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:48:32 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" returned: 0 in 1.046s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:32 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412 Jun 12 04:48:32 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:33 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" returned: 0 in 0.722s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-quobyte-f235c3ac-ff11-45fa-b4c1-4ec070fbd412" released by "delete_volume" :: held 1.869s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Created reservations ['1e2459bd-f09c-4987-b0a6-192ab0e05b1f', 'a0aca5d2-e604-4038-b460-eb62f40416c0', '27f2ef07-8f36-474f-b38b-8fc5e7633439', '2496d3d9-b9b4-4ec1-a289-2455cf97153e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:33 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:33 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "cinder-6fde58f0-3af7-440f-8bea-c206f9302ae5-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-6fde58f0-3af7-440f-8bea-c206f9302ae5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "cinder-quobyte-6fde58f0-3af7-440f-8bea-c206f9302ae5" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-quobyte-6fde58f0-3af7-440f-8bea-c206f9302ae5" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[914fe75a-1ad1-4e8b-ba27-9fb8710f3b2a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:34 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 Jun 12 04:48:34 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:34 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.852s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Deleted volume successfully. Jun 12 04:48:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9a6b843b-765d-48f5-bc75-38330fa94868 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-f235c3ac-ff11-45fa-b4c1-4ec070fbd412-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:35 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5" returned: 0 in 0.847s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:35 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5 Jun 12 04:48:35 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:35 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6fde58f0-3af7-440f-8bea-c206f9302ae5" returned: 0 in 0.651s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-quobyte-6fde58f0-3af7-440f-8bea-c206f9302ae5" released by "delete_volume" :: held 1.553s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Created reservations ['f9f7c4e6-2888-4c3e-887e-80bd0077b92c', '52f08a41-657c-45f7-884a-52f92578bd8c', 'e70b51e7-a94d-49ba-bad8-17db782140f0', '126d1c9f-65a7-4b9a-bf56-2d3777126a60'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:35 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:48:35 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:36 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.724s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:36 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:48:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Deleted volume successfully. Jun 12 04:48:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-61661149-d602-44a7-934b-97c845fe6524 tempest-AttachVolumeTestJSON-732787644 None] Lock "cinder-6fde58f0-3af7-440f-8bea-c206f9302ae5-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:39 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Flow 'volume_create_manager' (a108e155-bf8b-4855-89d6-29f2065cb796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15ebc8a-e08d-476a-b63d-d05fe890f086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15ebc8a-e08d-476a-b63d-d05fe890f086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1193408541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01efb619-f413-4561-b7b4-84b207d53d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b407f3c39b47bc84e52db2ce1787fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:40Z,use_quota=True,user_id='b668ba33f2e442188d17ae8d06ffab35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ff910c-502f-4117-a653-25b24b450a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ff910c-502f-4117-a653-25b24b450a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e524dd-bb4e-4b94-a4b3-96022805973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e524dd-bb4e-4b94-a4b3-96022805973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01efb619-f413-4561-b7b4-84b207d53d31', 'volume_name': 'volume-01efb619-f413-4561-b7b4-84b207d53d31', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e169c357-485f-4086-ac26-0268052dfee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e169c357-485f-4086-ac26-0268052dfee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0658e6-5d0b-4bfc-85c7-0cc166294452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Volume 01efb619-f413-4561-b7b4-84b207d53d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01efb619-f413-4561-b7b4-84b207d53d31', 'volume_size': 1} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1193408541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01efb619-f413-4561-b7b4-84b207d53d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b407f3c39b47bc84e52db2ce1787fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:48:40Z,use_quota=True,user_id='b668ba33f2e442188d17ae8d06ffab35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Creating volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:48:40 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:48:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:40 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 1073741824 Jun 12 04:48:40 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:41 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 1073741824" returned: 0 in 0.879s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:41 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 Jun 12 04:48:41 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:41 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31" returned: 0 in 0.707s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0658e6-5d0b-4bfc-85c7-0cc166294452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01efb619-f413-4561-b7b4-84b207d53d31', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad11ef-bec4-4d85-a420-ff1e9d0aaca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:48:41 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Volume volume-01efb619-f413-4561-b7b4-84b207d53d31 (01efb619-f413-4561-b7b4-84b207d53d31): created successfully Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad11ef-bec4-4d85-a420-ff1e9d0aaca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:48:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Flow 'volume_create_manager' (a108e155-bf8b-4855-89d6-29f2065cb796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:48:41 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6215ec82-5bba-4cc5-9434-ac8179c8c0a0 tempest-SnapshotsActionsTest-2119086765 None] Created volume successfully. Jun 12 04:48:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Creating offline snapshot 1f38e6ad-1a31-416e-b1f1-a365bb03856b of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:48:42 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f20bfbc-74de-48ff-a255-631a12a24cfe]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:42 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 Jun 12 04:48:42 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:43 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31" returned: 0 in 0.838s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:43 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b 1G Jun 12 04:48:43 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:44 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b 1G" returned: 0 in 0.917s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:44 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:48:44 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:44 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.799s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:44 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b is being set with open permissions: ugo+rw Jun 12 04:48:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:44 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:48:44 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:45 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.613s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:45 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info Jun 12 04:48:45 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:46 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info" returned: 0 in 0.628s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:46 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info is being set with open permissions: ugo+rw Jun 12 04:48:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:46 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info Jun 12 04:48:46 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:46 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.info" returned: 0 in 0.635s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-80c7538d-2c98-419f-930f-010938ffe971 tempest-SnapshotsActionsTest-2119086765 None] Create snapshot completed successfully Jun 12 04:48:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Creating offline snapshot 49f494c9-1c31-493a-8c02-03c5b5150d1a of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:48:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f562c1f-205c-473d-b7a5-09c543e81e84]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:48 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:48:48 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:49 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.747s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:48:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:49 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a 1G Jun 12 04:48:49 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:50 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a 1G" returned: 0 in 0.866s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:50 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a Jun 12 04:48:50 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:50 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a" returned: 0 in 0.715s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:50 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a is being set with open permissions: ugo+rw Jun 12 04:48:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:50 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a Jun 12 04:48:50 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:51 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:51 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=115,cinder:INSERT=22,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:48:51 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=98,cinder:INSERT=21,cinder:UPDATE=106,cinder:DELETE=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:48:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:48:51 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d26f646f-14e2-4cdf-b83b-eb128a9517fc tempest-SnapshotsActionsTest-2119086765 None] Create snapshot completed successfully Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-49f494c9-1c31-493a-8c02-03c5b5150d1a-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-49f494c9-1c31-493a-8c02-03c5b5150d1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-49f494c9-1c31-493a-8c02-03c5b5150d1a" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-49f494c9-1c31-493a-8c02-03c5b5150d1a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Deleting offline snapshot 49f494c9-1c31-493a-8c02-03c5b5150d1a of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] snapshot_file for this snap is: volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918ed5f-daaa-43d3-b02d-b38183374c70]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:52 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a Jun 12 04:48:52 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:53 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a" returned: 0 in 0.822s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:48:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee899e-0db7-4f3a-a5bd-1e1a7ee95c0f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:53 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:48:53 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:54 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:48:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:54 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a Jun 12 04:48:54 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:55 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a" returned: 0 in 0.788s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:55 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a Jun 12 04:48:55 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:55 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.49f494c9-1c31-493a-8c02-03c5b5150d1a" returned: 0 in 0.642s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-49f494c9-1c31-493a-8c02-03c5b5150d1a" released by "_delete_snapshot" :: held 3.107s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" released by "delete_snapshot" :: held 3.136s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:55 devstack cinder-volume[92320]: WARNING cinder.quota [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:48:55 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Created reservations ['57006227-6354-438e-9760-cf287b4dd58d', '2d28b1cd-35c9-4e9c-8c8c-2bff368bb02c', '80167768-5601-4987-921d-fe5866dec5bc', '5fdc7707-c513-46c7-af52-36f47a6cc929'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:48:55 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Delete snapshot completed successfully. Jun 12 04:48:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1857304a-1690-4697-94d1-59ff46324e47 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-49f494c9-1c31-493a-8c02-03c5b5150d1a-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:48:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:48:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:48:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Creating offline snapshot 1d4ac591-8252-422a-b900-8fe9ff980216 of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:48:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a34518-ead5-4355-a15a-0b3e20e30129]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:48:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:57 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:48:57 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:58 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:48:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:58 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 1G Jun 12 04:48:58 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:58 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 1G" returned: 0 in 0.811s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:58 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 Jun 12 04:48:58 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:48:59 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jun 12 04:48:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216" returned: 0 in 0.688s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:48:59 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 is being set with open permissions: ugo+rw Jun 12 04:48:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:48:59 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 Jun 12 04:48:59 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:00 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216" returned: 0 in 0.603s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-71767672-86fa-481c-8bb0-b9ff0f53d081 tempest-SnapshotsActionsTest-2119086765 None] Create snapshot completed successfully Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-1d4ac591-8252-422a-b900-8fe9ff980216-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-1d4ac591-8252-422a-b900-8fe9ff980216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-1d4ac591-8252-422a-b900-8fe9ff980216" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-1d4ac591-8252-422a-b900-8fe9ff980216" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Deleting offline snapshot 1d4ac591-8252-422a-b900-8fe9ff980216 of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] snapshot_file for this snap is: volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e6ebae-a874-4d66-8d42-eed26599fc59]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:00 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 Jun 12 04:49:00 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:01 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216" returned: 0 in 0.719s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:01 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[771528ed-d243-418e-a960-f92eb5d7f53b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:01 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:01 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:02 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:02 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 Jun 12 04:49:02 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:02 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216" returned: 0 in 0.850s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:02 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216 Jun 12 04:49:02 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:03 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1d4ac591-8252-422a-b900-8fe9ff980216" returned: 0 in 0.647s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-1d4ac591-8252-422a-b900-8fe9ff980216" released by "_delete_snapshot" :: held 3.076s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" released by "delete_snapshot" :: held 3.108s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:03 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Created reservations ['f595d780-620b-40a5-b3d2-88359447cbe2', '92256ef8-70fb-45b2-806f-4fe5a1e93bd1', '9e038c2d-5f49-4d7e-80cb-728a0b9e632a', '0769a1c1-22b8-4ecb-a5c2-c3859d34d317'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Delete snapshot completed successfully. Jun 12 04:49:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f37a4064-1947-47d8-bf9c-db3ae387796f tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-1d4ac591-8252-422a-b900-8fe9ff980216-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Creating offline snapshot ec136146-1901-4027-8d47-f460622a5479 of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6205308c-1a68-4ca7-8cab-238e7787b5ee]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:05 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:05 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:05 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.705s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:05 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 1G Jun 12 04:49:05 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:06 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 1G" returned: 0 in 0.877s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:06 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 Jun 12 04:49:06 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:07 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479" returned: 0 in 0.709s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:07 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 is being set with open permissions: ugo+rw Jun 12 04:49:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:07 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 Jun 12 04:49:07 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:08 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479" returned: 0 in 0.668s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ff76441c-6109-4f81-9afc-e0d0692ccbd7 tempest-SnapshotsActionsTest-2119086765 None] Create snapshot completed successfully Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-ec136146-1901-4027-8d47-f460622a5479-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-ec136146-1901-4027-8d47-f460622a5479-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" acquired by "delete_snapshot" :: waited 0.043s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-ec136146-1901-4027-8d47-f460622a5479" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-ec136146-1901-4027-8d47-f460622a5479" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Deleting offline snapshot ec136146-1901-4027-8d47-f460622a5479 of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] snapshot_file for this snap is: volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccccc06-c88d-4a12-8da8-dc81831c15a1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:10 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 Jun 12 04:49:10 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:11 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479" returned: 0 in 1.121s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a989c6-48ec-458a-b398-3fc82404a4e8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:11 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:11 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:11 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.832s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:11 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 Jun 12 04:49:11 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-34048d27-92bf-45c9-8495-16953b970271 tempest-TestShelveInstance-531523193 None] Terminate volume connection completed successfully. Jun 12 04:49:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-34048d27-92bf-45c9-8495-16953b970271 tempest-TestShelveInstance-531523193 None] Deleting attachment dfb8c916-004c-41e9-b136-510776a0fc26. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:49:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Acquiring lock "cinder-e92d26d2-2d6c-407a-8f84-1882f9368b4e-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Lock "cinder-e92d26d2-2d6c-407a-8f84-1882f9368b4e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Acquiring lock "cinder-quobyte-e92d26d2-2d6c-407a-8f84-1882f9368b4e" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Lock "cinder-quobyte-e92d26d2-2d6c-407a-8f84-1882f9368b4e" acquired by "delete_volume" :: waited 0.047s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c343c-5a2e-4634-913a-1a198023bdb5]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:13 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:49:13 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:13 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479" returned: 0 in 1.223s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:13 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479 Jun 12 04:49:13 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:13 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 0.914s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:13 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:49:13 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:14 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.ec136146-1901-4027-8d47-f460622a5479" returned: 0 in 0.937s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-ec136146-1901-4027-8d47-f460622a5479" released by "_delete_snapshot" :: held 4.279s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" released by "delete_snapshot" :: held 4.328s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Created reservations ['6a0eac53-8289-46b9-aeff-7c876677206e', '86f7c50e-2891-424f-8dd4-c891657e3624', 'b9c76fce-2c6e-4154-957c-4533446a0458', 'cfafb026-985c-4ded-a0e5-02fb8ce3533b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Delete snapshot completed successfully. Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1fc0a812-e2b3-4859-849f-2897326bf289 tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-ec136146-1901-4027-8d47-f460622a5479-delete_snapshot" released by "delete_snapshot" :: held 4.512s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:14 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 1 in 1.052s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:49:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:14 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e Jun 12 04:49:14 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Creating offline snapshot 0281b12a-77be-4590-a983-3ffc4e3460ef of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ba736-29a8-4160-a5f2-a51371304e56]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:15 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e92d26d2-2d6c-407a-8f84-1882f9368b4e" returned: 0 in 0.700s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Lock "cinder-quobyte-e92d26d2-2d6c-407a-8f84-1882f9368b4e" released by "delete_volume" :: held 2.772s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG cinder.quota [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Created reservations ['606b9861-8d30-48a0-a3dd-2049d281bf3e', 'a7ce102b-e3b6-4ea5-8d6a-802a0d2873ec', 'e354fe7b-e2aa-40c7-b06e-652562604a09', 'dfdaf72a-b893-4e3b-bf55-a44a74570972'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:15 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:15 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:15 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:49:15 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:16 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 1.085s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:16 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef 1G Jun 12 04:49:16 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:16 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.837s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:16 devstack cinder-volume[92320]: DEBUG cinder.manager [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:49:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Deleted volume successfully. Jun 12 04:49:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-82b8fd27-48e1-40b9-8e37-ae50690cdcd0 req-cf323471-6f4f-4e47-a018-6c708b45af67 tempest-TestShelveInstance-531523193 None] Lock "cinder-e92d26d2-2d6c-407a-8f84-1882f9368b4e-delete_volume" released by "delete_volume" :: held 3.980s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:17 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef 1G" returned: 0 in 0.887s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:17 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef Jun 12 04:49:17 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:18 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef" returned: 0 in 0.758s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:18 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef is being set with open permissions: ugo+rw Jun 12 04:49:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:18 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef Jun 12 04:49:18 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:18 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef" returned: 0 in 0.662s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-33cf3e7c-573e-4c60-ba10-f662c7fe9d57 tempest-SnapshotsActionsTest-2119086765 None] Create snapshot completed successfully Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-0281b12a-77be-4590-a983-3ffc4e3460ef-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-0281b12a-77be-4590-a983-3ffc4e3460ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Acquiring lock "cinder-quobyte-0281b12a-77be-4590-a983-3ffc4e3460ef" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-0281b12a-77be-4590-a983-3ffc4e3460ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Deleting offline snapshot 0281b12a-77be-4590-a983-3ffc4e3460ef of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] snapshot_file for this snap is: volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b1710-1fb9-4d8c-9872-fc44c7bb2526]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:20 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef Jun 12 04:49:20 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:20 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef" returned: 0 in 0.877s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ae9f8e-b187-4b12-9797-608a452fcc43]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:20 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:20 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:21 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.868s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:21 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef Jun 12 04:49:21 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:22 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef" returned: 0 in 0.841s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:22 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef Jun 12 04:49:22 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:23 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.0281b12a-77be-4590-a983-3ffc4e3460ef" returned: 0 in 0.649s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-0281b12a-77be-4590-a983-3ffc4e3460ef" released by "_delete_snapshot" :: held 3.353s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" released by "delete_snapshot" :: held 3.385s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:23 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Created reservations ['e5ab174c-aabb-40b7-bbd2-a44874c395b6', '1cfa17de-07b6-463c-a523-a5af13fdb414', '282b94c4-058e-46f7-8c3d-a8159e91a8b5', 'df59f2f5-c8b6-450a-b7a5-c1c1975e8eb1'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Delete snapshot completed successfully. Jun 12 04:49:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bd477581-43c0-418d-88ea-2b6153820eee tempest-SnapshotsActionsTest-1117140665 None] Lock "cinder-0281b12a-77be-4590-a983-3ffc4e3460ef-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "cinder-1f38e6ad-1a31-416e-b1f1-a365bb03856b-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-1f38e6ad-1a31-416e-b1f1-a365bb03856b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "cinder-quobyte-1f38e6ad-1a31-416e-b1f1-a365bb03856b" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-quobyte-1f38e6ad-1a31-416e-b1f1-a365bb03856b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Deleting offline snapshot 1f38e6ad-1a31-416e-b1f1-a365bb03856b of volume 01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] snapshot_file for this snap is: volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c5eec0-8205-4f9b-aa8d-8e67e7afcb35]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:24 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:24 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:25 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.765s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01efb619-f413-4561-b7b4-84b207d53d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:25 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb82a38-2134-411f-97eb-5217f028516f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:25 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 Jun 12 04:49:25 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:26 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31" returned: 0 in 0.743s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:26 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:26 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:26 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:26 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b Jun 12 04:49:26 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:27 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31.1f38e6ad-1a31-416e-b1f1-a365bb03856b" returned: 0 in 0.604s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-quobyte-1f38e6ad-1a31-416e-b1f1-a365bb03856b" released by "_delete_snapshot" :: held 2.983s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" released by "delete_snapshot" :: held 3.009s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Created reservations ['116a1d46-f7af-48c6-9386-26ff7644758e', '9ddd1c57-48b6-4e3f-a450-7af1a4e4fe45', '390b4bb2-a398-4e3e-92c8-f8c731ff0168', '993dbf33-c400-4d07-8ebf-ffa1e0cefdb6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Delete snapshot completed successfully. Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e7c3684-8ccd-45b9-9024-14bdb3d5f30c tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-1f38e6ad-1a31-416e-b1f1-a365bb03856b-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "cinder-01efb619-f413-4561-b7b4-84b207d53d31-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-01efb619-f413-4561-b7b4-84b207d53d31-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef93d02-f0ad-41bc-98fa-52427e93d838]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:27 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 Jun 12 04:49:27 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Flow 'volume_create_manager' (1f0a6e30-58ec-4d2b-82ed-6c4bb671bb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6902db17-e5ff-4470-8759-35e38baaddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6902db17-e5ff-4470-8759-35e38baaddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1934409917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21b13a9-0666-4648-9aff-1cd06a2c0036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5a8e5817094751a5cfd9f175ba7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:49:28Z,use_quota=True,user_id='bfbceab89f034dcf92d7e6621a7667a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508b8216-bbe1-4573-8fee-f735424b0532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508b8216-bbe1-4573-8fee-f735424b0532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68285090-9b74-4a04-b014-d80f92e1a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68285090-9b74-4a04-b014-d80f92e1a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21b13a9-0666-4648-9aff-1cd06a2c0036', 'volume_name': 'volume-b21b13a9-0666-4648-9aff-1cd06a2c0036', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98aa82c8-5cf9-45c6-9692-a0ef169d2a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98aa82c8-5cf9-45c6-9692-a0ef169d2a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47d486a-15e1-4245-944d-c42f95f53935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:28 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Volume b21b13a9-0666-4648-9aff-1cd06a2c0036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21b13a9-0666-4648-9aff-1cd06a2c0036', 'volume_size': 1} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1934409917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21b13a9-0666-4648-9aff-1cd06a2c0036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5a8e5817094751a5cfd9f175ba7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:49:28Z,use_quota=True,user_id='bfbceab89f034dcf92d7e6621a7667a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Creating volume b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:49:28 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:28 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 1073741824 Jun 12 04:49:28 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:28 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31" returned: 0 in 0.763s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:28 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31 Jun 12 04:49:28 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:29 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 1073741824" returned: 0 in 0.918s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:29 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:29 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:29 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-01efb619-f413-4561-b7b4-84b207d53d31" returned: 0 in 0.700s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-quobyte-01efb619-f413-4561-b7b4-84b207d53d31" released by "delete_volume" :: held 1.536s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Created reservations ['e9999072-830c-4bff-ab34-bb4676c5d679', 'a26587d8-30c2-413d-a37b-6f34ac587515', 'fd5a3cc5-95da-4247-9ec2-453beab498aa', '3d6435e7-e7c9-4d5c-a719-0b22e33c2578'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:29 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:49:29 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:29 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47d486a-15e1-4245-944d-c42f95f53935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21b13a9-0666-4648-9aff-1cd06a2c0036', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8a26e6-607e-4902-9361-25178094397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:29 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Volume volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 (b21b13a9-0666-4648-9aff-1cd06a2c0036): created successfully Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8a26e6-607e-4902-9361-25178094397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Flow 'volume_create_manager' (1f0a6e30-58ec-4d2b-82ed-6c4bb671bb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:49:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d5f74556-2d86-420f-8664-82672f642c98 tempest-VolumeDependencyTests-870901300 None] Created volume successfully. Jun 12 04:49:30 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:49:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Deleted volume successfully. Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8b9cfea0-2bde-4805-9896-9f70e650c151 tempest-SnapshotsActionsTest-2119086765 None] Lock "cinder-01efb619-f413-4561-b7b4-84b207d53d31-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Creating offline snapshot d31fcbe7-1824-4ee4-a5c1-99106995deed of volume b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf3e14-ff6f-4a6e-91c1-b944be7bfbb1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:30 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:30 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:31 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.768s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:31 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed 1G Jun 12 04:49:31 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:31 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:49:31 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:32 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed 1G" returned: 0 in 0.843s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:32 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed Jun 12 04:49:32 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:32 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:49:32 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed" returned: 0 in 0.753s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:32 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed is being set with open permissions: ugo+rw Jun 12 04:49:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:33 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed Jun 12 04:49:33 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:33 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed" returned: 0 in 0.598s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:33 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info Jun 12 04:49:33 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:34 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info" returned: 0 in 0.610s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:34 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info is being set with open permissions: ugo+rw Jun 12 04:49:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:34 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info Jun 12 04:49:34 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:34 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.info" returned: 0 in 0.638s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.321s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-51cd5711-0b3f-4f7b-b4bc-e4f42436f1de tempest-VolumeDependencyTests-870901300 None] Create snapshot completed successfully Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Flow 'volume_create_manager' (7cf63679-f5c7-4154-9be5-644c6bf468d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5587513f-e0e1-4eb3-9340-f57209456f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5587513f-e0e1-4eb3-9340-f57209456f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1948736772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece53a9e-5c8f-4fed-9705-ea3d426941b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da9ffc459541a98e75ad67c062e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:49:35Z,use_quota=True,user_id='19aee15328234c81b9eb14943f7a29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d821ca04-016c-47a7-826a-0304d5041a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d821ca04-016c-47a7-826a-0304d5041a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98747a18-ccf6-4051-af86-7ff557d668be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98747a18-ccf6-4051-af86-7ff557d668be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece53a9e-5c8f-4fed-9705-ea3d426941b3', 'volume_name': 'volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4c1167-c89c-4663-826b-15fc595a5eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4c1167-c89c-4663-826b-15fc595a5eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab54970-e098-4ebb-8cb9-bc3cfce34926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Volume ece53a9e-5c8f-4fed-9705-ea3d426941b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3', 'volume_size': 1} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1948736772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece53a9e-5c8f-4fed-9705-ea3d426941b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da9ffc459541a98e75ad67c062e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:49:35Z,use_quota=True,user_id='19aee15328234c81b9eb14943f7a29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Creating volume ece53a9e-5c8f-4fed-9705-ea3d426941b3 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:49:35 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:49:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:35 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 1073741824 Jun 12 04:49:35 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:36 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 1073741824" returned: 0 in 0.995s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:36 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 Jun 12 04:49:36 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Flow 'volume_create_manager' (55f59306-60ed-410d-9b85-2e41fa2c4017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5feae58-364a-49e2-a609-4192b5017eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5feae58-364a-49e2-a609-4192b5017eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1974002044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62222de-6cb5-421e-8efa-76c133654c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5a8e5817094751a5cfd9f175ba7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d31fcbe7-1824-4ee4-a5c1-99106995deed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:49:36Z,use_quota=True,user_id='bfbceab89f034dcf92d7e6621a7667a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c201fd0d-657c-44ff-945a-0057da179ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c201fd0d-657c-44ff-945a-0057da179ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f6fe7b-8186-4dd3-a7b0-57df01d3ba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f6fe7b-8186-4dd3-a7b0-57df01d3ba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f62222de-6cb5-421e-8efa-76c133654c6b', 'volume_name': 'volume-f62222de-6cb5-421e-8efa-76c133654c6b', 'volume_size': 1, 'snapshot_id': 'd31fcbe7-1824-4ee4-a5c1-99106995deed'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8182d774-d944-44ac-a651-ae33fb7a9dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8182d774-d944-44ac-a651-ae33fb7a9dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a64ef0-fd2b-4b2c-a9c6-b38625d58a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Volume f62222de-6cb5-421e-8efa-76c133654c6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f62222de-6cb5-421e-8efa-76c133654c6b', 'volume_size': 1, 'snapshot_id': 'd31fcbe7-1824-4ee4-a5c1-99106995deed'} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:36 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3" returned: 0 in 0.608s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.471s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-quobyte-d31fcbe7-1824-4ee4-a5c1-99106995deed-f62222de-6cb5-421e-8efa-76c133654c6b" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab54970-e098-4ebb-8cb9-bc3cfce34926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de292ab-1217-4d5c-bcb2-a765b025d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-d31fcbe7-1824-4ee4-a5c1-99106995deed-f62222de-6cb5-421e-8efa-76c133654c6b" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Creating volume f62222de-6cb5-421e-8efa-76c133654c6b from snapshot d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-quobyte-f62222de-6cb5-421e-8efa-76c133654c6b" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:37 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Volume volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 (ece53a9e-5c8f-4fed-9705-ea3d426941b3): created successfully Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de292ab-1217-4d5c-bcb2-a765b025d356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Flow 'volume_create_manager' (7cf63679-f5c7-4154-9be5-644c6bf468d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-f62222de-6cb5-421e-8efa-76c133654c6b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] snapshot: d31fcbe7-1824-4ee4-a5c1-99106995deed, volume: f62222de-6cb5-421e-8efa-76c133654c6b, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cc34f3c0-374b-442c-a2bb-6742e05c2355 tempest-AttachVolumeNegativeTest-522445774 None] Created volume successfully. Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d672bf5-a775-44e2-8fbe-7e670ddbddd3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:37 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed Jun 12 04:49:37 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:37 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed" returned: 0 in 0.785s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b21b13a9-0666-4648-9aff-1cd06a2c0036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[23862093-08b9-4b9e-a328-90f88e204d59]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:38 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:38 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:38 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.745s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:38 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 04:49:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:38 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b Jun 12 04:49:38 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:44 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b" returned: 0 in 5.545s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:44 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f203e-e713-4c50-a90a-86312ab5d792]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:44 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:44 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:45 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.925s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:49:45 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Converted 1024.00 MB image at 184.65 MB/s Jun 12 04:49:45 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b is being set with open permissions: ugo+rw Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:45 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b Jun 12 04:49:45 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:45 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b" returned: 0 in 0.602s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-f62222de-6cb5-421e-8efa-76c133654c6b" released by "_copy_volume_from_snapshot" :: held 8.717s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-d31fcbe7-1824-4ee4-a5c1-99106995deed-f62222de-6cb5-421e-8efa-76c133654c6b" released by "_create_volume_from_snapshot" :: held 8.774s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.809s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.652s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a64ef0-fd2b-4b2c-a9c6-b38625d58a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62222de-6cb5-421e-8efa-76c133654c6b', 'volume_size': 1, 'snapshot_id': 'd31fcbe7-1824-4ee4-a5c1-99106995deed'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d37bcce-44b9-47c7-9d9a-024e08c4ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab589d29-3842-45b8-a1b0-616ec05ff70a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:45 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Volume volume-f62222de-6cb5-421e-8efa-76c133654c6b (f62222de-6cb5-421e-8efa-76c133654c6b): created successfully Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d37bcce-44b9-47c7-9d9a-024e08c4ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:49:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Flow 'volume_create_manager' (55f59306-60ed-410d-9b85-2e41fa2c4017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:49:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7ec57e10-eedc-465d-901b-e6f47c6fbb93 tempest-VolumeDependencyTests-870901300 None] Created volume successfully. Jun 12 04:49:45 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 Jun 12 04:49:45 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-d31fcbe7-1824-4ee4-a5c1-99106995deed-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Lock "cinder-d31fcbe7-1824-4ee4-a5c1-99106995deed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-quobyte-b21b13a9-0666-4648-9aff-1cd06a2c0036" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-b21b13a9-0666-4648-9aff-1cd06a2c0036" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-quobyte-d31fcbe7-1824-4ee4-a5c1-99106995deed" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-d31fcbe7-1824-4ee4-a5c1-99106995deed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Deleting offline snapshot d31fcbe7-1824-4ee4-a5c1-99106995deed of volume b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] snapshot_file for this snap is: volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf65f39b-8ea1-439a-b2fe-bc41507a060a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:46 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed Jun 12 04:49:46 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:46 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51a89a79-4c4f-45c1-9dea-97f7a99a083f', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:49:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-ce00ec1f-61fc-459f-823e-36cde1a22d51 req-8c1210d8-ac74-466f-a9a8-184b939c4f13 tempest-AttachVolumeNegativeTest-522445774 None] attachment_update completed successfully. Jun 12 04:49:47 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed" returned: 0 in 0.882s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b21b13a9-0666-4648-9aff-1cd06a2c0036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:49:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa12c22-5eb9-4344-9acc-a4992acb1521]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:47 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:47 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:48 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.780s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:48 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed Jun 12 04:49:48 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:48 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:48 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed Jun 12 04:49:48 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:49 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036.d31fcbe7-1824-4ee4-a5c1-99106995deed" returned: 0 in 0.608s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-d31fcbe7-1824-4ee4-a5c1-99106995deed" released by "_delete_snapshot" :: held 3.138s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-b21b13a9-0666-4648-9aff-1cd06a2c0036" released by "delete_snapshot" :: held 3.165s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:49 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Created reservations ['e3c7a5d6-5167-40f9-a84d-e9d50486e558', 'b7528513-dae0-4d6a-a56b-a3641ef1c1a7', '4765f932-a21e-458c-b1b7-42b883403494', 'dc0e778f-fc4a-4a36-8489-9d87cede8c9e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Delete snapshot completed successfully. Jun 12 04:49:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346f1e18-d2ca-4cd6-828b-d4519322ec9a tempest-VolumeDependencyTests-870901300 None] Lock "cinder-d31fcbe7-1824-4ee4-a5c1-99106995deed-delete_snapshot" released by "delete_snapshot" :: held 3.316s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-b21b13a9-0666-4648-9aff-1cd06a2c0036-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-b21b13a9-0666-4648-9aff-1cd06a2c0036-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-quobyte-b21b13a9-0666-4648-9aff-1cd06a2c0036" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-b21b13a9-0666-4648-9aff-1cd06a2c0036" acquired by "delete_volume" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f037c2-45d3-4b31-94f5-8f712c5fb034]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:50 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:50 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:51 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.795s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:51 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036 Jun 12 04:49:51 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:52 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b21b13a9-0666-4648-9aff-1cd06a2c0036" returned: 0 in 0.667s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-b21b13a9-0666-4648-9aff-1cd06a2c0036" released by "delete_volume" :: held 1.625s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=64,cinder:INSERT=17,cinder:UPDATE=65,cinder:DELETE=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=69,cinder:UPDATE=63,cinder:DELETE=6,cinder:INSERT=18 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Created reservations ['b2b4ea52-b6c5-4cbe-8817-4208a1280744', '24b339ca-8232-4f2c-9cd8-7372ca5b6097', 'd7072943-14d6-4045-a524-492cdff5429c', '2613c089-f687-4931-847c-ca00b9a344ba'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:52 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:49:52 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-f62222de-6cb5-421e-8efa-76c133654c6b-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-f62222de-6cb5-421e-8efa-76c133654c6b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "cinder-quobyte-f62222de-6cb5-421e-8efa-76c133654c6b" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:49:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-f62222de-6cb5-421e-8efa-76c133654c6b" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fb2d6d-69b6-4898-98f1-fb79d55dea74]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:53 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b Jun 12 04:49:53 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:53 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.883s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:49:53 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Deleted volume successfully. Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d1bc7710-4f43-4f8d-881b-6969d407cc71 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-b21b13a9-0666-4648-9aff-1cd06a2c0036-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:53 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b" returned: 0 in 0.847s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:53 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b Jun 12 04:49:53 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:54 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f62222de-6cb5-421e-8efa-76c133654c6b" returned: 0 in 0.702s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-quobyte-f62222de-6cb5-421e-8efa-76c133654c6b" released by "delete_volume" :: held 1.615s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Created reservations ['a7ed1f24-3f7a-4bd4-ba13-9729f42e0af1', 'f4c8740f-eafb-4f22-93d2-93120c0c5ca4', '5c8a12cd-09a3-4af7-85f9-4ae7f40baf6a', '63ee39a2-98e5-4b22-a84f-1d21d9984c1d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:49:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:49:54 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:49:54 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:49:55 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jun 12 04:49:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.867s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:49:55 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:49:55 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Deleted volume successfully. Jun 12 04:49:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fac30e26-7cfc-45bd-a107-1f40971139f3 tempest-VolumeDependencyTests-870901300 None] Lock "cinder-f62222de-6cb5-421e-8efa-76c133654c6b-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=8,cinder:INSERT=6,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:50:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (780fdf51-149d-4f63-b936-f8d5ab654439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192829a3-eb94-481d-a7d2-7b2428317acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192829a3-eb94-481d-a7d2-7b2428317acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1882883594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8338798-a0f8-4702-90b3-9cedada89cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:24Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4635a26-f830-4199-a1a8-908531609146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4635a26-f830-4199-a1a8-908531609146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d137a5-4090-493b-977b-0088512fec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d137a5-4090-493b-977b-0088512fec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8338798-a0f8-4702-90b3-9cedada89cea', 'volume_name': 'volume-c8338798-a0f8-4702-90b3-9cedada89cea', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc17a4-3067-4d44-bf2d-0e4125f4a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc17a4-3067-4d44-bf2d-0e4125f4a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cae2ca-91cf-4c43-8f4b-9a7100339788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Volume c8338798-a0f8-4702-90b3-9cedada89cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8338798-a0f8-4702-90b3-9cedada89cea', 'volume_size': 1} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1882883594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8338798-a0f8-4702-90b3-9cedada89cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:24Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Creating volume c8338798-a0f8-4702-90b3-9cedada89cea {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:50:23 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:50:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:23 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea 1073741824 Jun 12 04:50:23 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:24 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea 1073741824" returned: 0 in 0.765s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:24 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea Jun 12 04:50:24 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:25 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea" returned: 0 in 0.615s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cae2ca-91cf-4c43-8f4b-9a7100339788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8338798-a0f8-4702-90b3-9cedada89cea', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ded5091-3a91-446e-be01-e2fe5fe65656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:25 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Volume volume-c8338798-a0f8-4702-90b3-9cedada89cea (c8338798-a0f8-4702-90b3-9cedada89cea): created successfully Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ded5091-3a91-446e-be01-e2fe5fe65656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (780fdf51-149d-4f63-b936-f8d5ab654439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:25 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-bbabdc58-8de9-4661-8ec0-00bfe71ff733 tempest-VolumesActionsTest-1443418969 None] Created volume successfully. Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ab547269-7499-4a8b-a148-ac23e18ffefa tempest-VolumesActionsTest-1443418969 None] Acquiring lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea" by "attach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ab547269-7499-4a8b-a148-ac23e18ffefa tempest-VolumesActionsTest-1443418969 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea" acquired by "attach_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ab547269-7499-4a8b-a148-ac23e18ffefa tempest-VolumesActionsTest-1443418969 None] Attaching volume c8338798-a0f8-4702-90b3-9cedada89cea to instance 855a17f6-c456-40c4-9a1d-b387922499ce at mountpoint /dev/vdb on host None. Jun 12 04:50:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ab547269-7499-4a8b-a148-ac23e18ffefa tempest-VolumesActionsTest-1443418969 None] Attach volume completed successfully. Jun 12 04:50:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ab547269-7499-4a8b-a148-ac23e18ffefa tempest-VolumesActionsTest-1443418969 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea" released by "attach_volume" :: held 0.114s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ac1ce262-eca3-45e1-b253-a87e277be650 tempest-VolumesActionsTest-1654252395 None] Terminate volume connection completed successfully. Jun 12 04:50:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ac1ce262-eca3-45e1-b253-a87e277be650 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-detach_volume" by "detach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ac1ce262-eca3-45e1-b253-a87e277be650 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ac1ce262-eca3-45e1-b253-a87e277be650 tempest-VolumesActionsTest-1654252395 None] Detaching volume c8338798-a0f8-4702-90b3-9cedada89cea from instance 855a17f6-c456-40c4-9a1d-b387922499ce. Jun 12 04:50:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ac1ce262-eca3-45e1-b253-a87e277be650 tempest-VolumesActionsTest-1654252395 None] Detach volume completed successfully. Jun 12 04:50:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ac1ce262-eca3-45e1-b253-a87e277be650 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a1ec5bdd-647f-4377-9862-d004fc5fb6c6 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-detach_volume" by "detach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a1ec5bdd-647f-4377-9862-d004fc5fb6c6 tempest-VolumesActionsTest-1443418969 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a1ec5bdd-647f-4377-9862-d004fc5fb6c6 tempest-VolumesActionsTest-1443418969 None] Volume detach called, but volume not attached. Jun 12 04:50:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a1ec5bdd-647f-4377-9862-d004fc5fb6c6 tempest-VolumesActionsTest-1443418969 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Acquiring lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Acquiring lock "cinder-quobyte-c8338798-a0f8-4702-90b3-9cedada89cea" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Lock "cinder-quobyte-c8338798-a0f8-4702-90b3-9cedada89cea" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d1ebd-6f55-46b7-823a-56fe83b8c889]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:50:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:29 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea Jun 12 04:50:29 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:29 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea" returned: 0 in 0.772s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:29 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea Jun 12 04:50:29 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:30 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c8338798-a0f8-4702-90b3-9cedada89cea" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Lock "cinder-quobyte-c8338798-a0f8-4702-90b3-9cedada89cea" released by "delete_volume" :: held 1.482s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Created reservations ['8c810ddd-de9b-4145-a88e-0b50c039ff84', '13b7de50-5b0b-4038-9fff-45a9fa3d0204', 'a7b0b2b2-488d-451e-bc79-b4b9773b33ac', 'f30284b5-e6a6-4cdb-94b7-ebba19323a32'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:30 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:50:30 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:31 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:50:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Deleted volume successfully. Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-5c571ddb-175b-4b7d-a045-ca215d36cc3a tempest-VolumesActionsTest-1443418969 None] Lock "cinder-c8338798-a0f8-4702-90b3-9cedada89cea-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:31 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:50:31 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:32 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.735s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:50:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:50:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:50:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (96aefe4b-5d78-455d-97c1-4f66d8386730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b325752b-7320-4d3f-ae95-369c9881d3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b325752b-7320-4d3f-ae95-369c9881d3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1540212577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327e94fc-c7db-4924-b7c9-d0c8f2edd704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:39Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9710ceeb-49a5-4174-8433-04e6a1d9fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9710ceeb-49a5-4174-8433-04e6a1d9fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25ee548-0fa4-432e-abf8-1d7fbb65f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25ee548-0fa4-432e-abf8-1d7fbb65f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327e94fc-c7db-4924-b7c9-d0c8f2edd704', 'volume_name': 'volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a149cd-a992-4b40-afde-d2a663aa52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a149cd-a992-4b40-afde-d2a663aa52dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef0df0a-5898-41dc-9865-81f732f0796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:39 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Volume 327e94fc-c7db-4924-b7c9-d0c8f2edd704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704', 'volume_size': 1} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1540212577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327e94fc-c7db-4924-b7c9-d0c8f2edd704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:39Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Creating volume 327e94fc-c7db-4924-b7c9-d0c8f2edd704 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:50:39 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:39 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 1073741824 Jun 12 04:50:39 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:39 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 1073741824" returned: 0 in 0.789s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:39 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 Jun 12 04:50:40 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:40 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704" returned: 0 in 0.616s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef0df0a-5898-41dc-9865-81f732f0796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde9d657-bfb3-4813-84a1-b426975cb4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Volume volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 (327e94fc-c7db-4924-b7c9-d0c8f2edd704): created successfully Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde9d657-bfb3-4813-84a1-b426975cb4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (96aefe4b-5d78-455d-97c1-4f66d8386730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e33b49df-bced-488e-96db-6bebbd6985ac tempest-VolumesActionsTest-1443418969 None] Created volume successfully. Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-327e94fc-c7db-4924-b7c9-d0c8f2edd704-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-327e94fc-c7db-4924-b7c9-d0c8f2edd704-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-quobyte-327e94fc-c7db-4924-b7c9-d0c8f2edd704" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-327e94fc-c7db-4924-b7c9-d0c8f2edd704" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af34824-52be-47f5-a492-b59dc30d2aa4]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:41 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 Jun 12 04:50:41 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:41 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-bf255333-8084-41b2-af44-fe1d1a96dc11 req-14eeb7ce-1d3a-4079-8c78-bf399c9dac69 tempest-AttachVolumeNegativeTest-522445774 None] Terminate volume connection completed successfully. Jun 12 04:50:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-bf255333-8084-41b2-af44-fe1d1a96dc11 req-14eeb7ce-1d3a-4079-8c78-bf399c9dac69 tempest-AttachVolumeNegativeTest-522445774 None] Deleting attachment 51a89a79-4c4f-45c1-9dea-97f7a99a083f. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:50:42 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704" returned: 0 in 0.722s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:42 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704 Jun 12 04:50:42 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:42 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-327e94fc-c7db-4924-b7c9-d0c8f2edd704" returned: 0 in 0.607s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-327e94fc-c7db-4924-b7c9-d0c8f2edd704" released by "delete_volume" :: held 1.368s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Created reservations ['f8d0e383-756c-4d64-be85-8950c8c36b5b', '46e37c85-ef98-4603-8987-88ad0e7f171a', '9d822985-6313-42d5-bb85-4fca28e41535', '01e9d9fd-b986-4671-84ae-ced6fd775a2e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:42 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:50:42 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:43 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:43 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:50:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Deleted volume successfully. Jun 12 04:50:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cef98cf4-7a7b-4656-b686-c46a35dddbc7 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-327e94fc-c7db-4924-b7c9-d0c8f2edd704-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:43 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:50:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (fecba614-2c84-4247-9bea-48041fc6efc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112d36f7-b93f-45fc-8ffd-d6397cf38c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112d36f7-b93f-45fc-8ffd-d6397cf38c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206874302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd709508-1faa-4c58-9bd1-a9704bc80173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:44Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94abb12-6372-414e-b936-053ece6cc453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94abb12-6372-414e-b936-053ece6cc453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdf9652-b1d7-4108-8d2f-69081ebfe422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdf9652-b1d7-4108-8d2f-69081ebfe422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd709508-1faa-4c58-9bd1-a9704bc80173', 'volume_name': 'volume-dd709508-1faa-4c58-9bd1-a9704bc80173', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dfe9b1-11f1-4a46-a00b-f59f134d368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dfe9b1-11f1-4a46-a00b-f59f134d368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc994746-1bd8-4e5d-8a21-562e4fc89a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:44 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Volume dd709508-1faa-4c58-9bd1-a9704bc80173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd709508-1faa-4c58-9bd1-a9704bc80173', 'volume_size': 1} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206874302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd709508-1faa-4c58-9bd1-a9704bc80173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:44Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Creating volume dd709508-1faa-4c58-9bd1-a9704bc80173 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:50:44 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:44 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 1073741824 Jun 12 04:50:44 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:44 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 1073741824" returned: 0 in 0.800s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:44 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 Jun 12 04:50:44 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:45 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173" returned: 0 in 0.930s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc994746-1bd8-4e5d-8a21-562e4fc89a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd709508-1faa-4c58-9bd1-a9704bc80173', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7920bd00-44a2-4b49-9fc1-addbb4e330ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:45 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Volume volume-dd709508-1faa-4c58-9bd1-a9704bc80173 (dd709508-1faa-4c58-9bd1-a9704bc80173): created successfully Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7920bd00-44a2-4b49-9fc1-addbb4e330ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (fecba614-2c84-4247-9bea-48041fc6efc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-46e55ccf-b3e9-4664-ade0-6c3798c775b4 tempest-VolumesActionsTest-1443418969 None] Created volume successfully. Jun 12 04:50:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-dd709508-1faa-4c58-9bd1-a9704bc80173-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-dd709508-1faa-4c58-9bd1-a9704bc80173-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-quobyte-dd709508-1faa-4c58-9bd1-a9704bc80173" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-dd709508-1faa-4c58-9bd1-a9704bc80173" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:46 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[16897ae2-8f94-4131-805e-11daf83058de]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:50:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:46 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 Jun 12 04:50:46 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:47 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173" returned: 0 in 0.746s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:47 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173 Jun 12 04:50:47 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:47 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-dd709508-1faa-4c58-9bd1-a9704bc80173" returned: 0 in 0.626s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-dd709508-1faa-4c58-9bd1-a9704bc80173" released by "delete_volume" :: held 1.411s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Created reservations ['6deecc65-0d34-4acc-b6a4-c7952c034940', 'bb8688e1-e674-4a56-8499-9f844bb703bd', '51b6d0ec-ff67-45ce-a030-6432ef488588', '90a00a2e-8580-4e66-94a8-0b181d6f3a66'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:47 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:50:47 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:48 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.646s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:50:48 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Deleted volume successfully. Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32a3a955-ecf5-4423-b330-a5a7ec687e18 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-dd709508-1faa-4c58-9bd1-a9704bc80173-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (9e95e2d6-9c38-4afd-8679-f5b30e9b8151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a80680-0181-4c03-accc-215a4e7482bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a80680-0181-4c03-accc-215a4e7482bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127895496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:49Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6faa57-c239-4184-a99c-0bef75ac9f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6faa57-c239-4184-a99c-0bef75ac9f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bf39e9-7a5a-46db-bc64-bf3bc1e59742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bf39e9-7a5a-46db-bc64-bf3bc1e59742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d', 'volume_name': 'volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcba486b-d9b9-4fc6-9587-421aa86cec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcba486b-d9b9-4fc6-9587-421aa86cec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8321eaf1-a77b-4183-98d7-b8ae79871d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:48 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Volume 610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d', 'volume_size': 1} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1127895496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:49Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Creating volume 610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:50:48 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:50:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:48 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d 1073741824 Jun 12 04:50:48 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:49 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d 1073741824" returned: 0 in 0.779s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:49 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d Jun 12 04:50:49 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:50 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d" returned: 0 in 0.599s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8321eaf1-a77b-4183-98d7-b8ae79871d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829e0a22-7db0-4e73-954e-6a767dfef449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:50 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Volume volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d (610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d): created successfully Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829e0a22-7db0-4e73-954e-6a767dfef449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (9e95e2d6-9c38-4afd-8679-f5b30e9b8151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:50 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5b439af8-5aa3-4fd4-9df6-4fa90e9044df tempest-VolumesActionsTest-1443418969 None] Created volume successfully. Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-quobyte-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e6459-4513-4189-a046-c2c725907078]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:51 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d Jun 12 04:50:51 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:51 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d" returned: 0 in 0.705s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:51 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d Jun 12 04:50:51 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:52 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d" returned: 0 in 0.605s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d" released by "delete_volume" :: held 1.352s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Created reservations ['7d4c3173-6365-4e8f-8e11-b7bae4b3d031', 'e125191e-ae88-4050-be33-a7a39c6657a6', 'b34f0f66-5130-48fe-8fa8-8a0d9f877d3a', '57b5167c-b350-4014-bf2f-d4f16735d6ed'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:52 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:50:52 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:53 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.632s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:50:53 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Deleted volume successfully. Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6cde24f8-391a-4196-8a73-8cf9315cbb10 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-610a9cb4-f3ae-4aa5-8a0c-db46cee59f0d-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (8e7f911d-f72a-42fe-9046-42d8f7062098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2961b1e-d9b3-40d1-b4fd-36e0e57edb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2961b1e-d9b3-40d1-b4fd-36e0e57edb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660981618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd738919-89ce-43f2-995a-0fbcc1d740f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:54Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228723d5-18c1-494b-9370-8b35ac67d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228723d5-18c1-494b-9370-8b35ac67d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8eeedf1-8d1d-48be-9608-f37cc1cc884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8eeedf1-8d1d-48be-9608-f37cc1cc884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd738919-89ce-43f2-995a-0fbcc1d740f0', 'volume_name': 'volume-bd738919-89ce-43f2-995a-0fbcc1d740f0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a62b88-8386-4f45-9149-525a4120bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a62b88-8386-4f45-9149-525a4120bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d082ea92-f5a5-4d42-a3d1-da0563197fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:53 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Volume bd738919-89ce-43f2-995a-0fbcc1d740f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd738919-89ce-43f2-995a-0fbcc1d740f0', 'volume_size': 1} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660981618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd738919-89ce-43f2-995a-0fbcc1d740f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:54Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Creating volume bd738919-89ce-43f2-995a-0fbcc1d740f0 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:50:53 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:50:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:53 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 1073741824 Jun 12 04:50:53 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:54 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 1073741824" returned: 0 in 0.814s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:54 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 Jun 12 04:50:54 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:55 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d082ea92-f5a5-4d42-a3d1-da0563197fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd738919-89ce-43f2-995a-0fbcc1d740f0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45112549-6d4b-410a-b945-644e30d76b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Volume volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 (bd738919-89ce-43f2-995a-0fbcc1d740f0): created successfully Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45112549-6d4b-410a-b945-644e30d76b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (8e7f911d-f72a-42fe-9046-42d8f7062098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:55 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d0118b42-1229-4fe1-bf5f-4d34a19221c0 tempest-VolumesActionsTest-1443418969 None] Created volume successfully. Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-bd738919-89ce-43f2-995a-0fbcc1d740f0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-bd738919-89ce-43f2-995a-0fbcc1d740f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "cinder-quobyte-bd738919-89ce-43f2-995a-0fbcc1d740f0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-bd738919-89ce-43f2-995a-0fbcc1d740f0" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b5fee-aaec-45be-8f4b-583f31735fa7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:56 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 Jun 12 04:50:56 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:56 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0" returned: 0 in 0.708s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:56 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0 Jun 12 04:50:56 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:57 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd738919-89ce-43f2-995a-0fbcc1d740f0" returned: 0 in 0.587s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-quobyte-bd738919-89ce-43f2-995a-0fbcc1d740f0" released by "delete_volume" :: held 1.334s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Created reservations ['468d8788-bca1-4c81-8207-1a7f23c5b4c3', '4da5ec99-3b64-4d2c-bd2e-6baeb818aafc', 'b80a14db-a6cd-460a-ab7b-92199a5e4f08', 'd08dea37-400a-4364-9803-bc78117028ff'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:57 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:50:57 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:58 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.570s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:50:58 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Deleted volume successfully. Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6404c531-43d4-441a-9c43-802a66bbfda9 tempest-VolumesActionsTest-1654252395 None] Lock "cinder-bd738919-89ce-43f2-995a-0fbcc1d740f0-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (7986b87a-951c-4054-8421-0c6b10b20489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481f9441-63af-4393-86aa-4b3a5c5c17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481f9441-63af-4393-86aa-4b3a5c5c17e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-907050245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6170779-f4ae-4a4a-b2cb-817d4f529525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:59Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e7ab34-1a10-4ab9-9207-f6ae9b5ebc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e7ab34-1a10-4ab9-9207-f6ae9b5ebc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa7d177-be23-4158-b7a5-800105fd17ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa7d177-be23-4158-b7a5-800105fd17ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6170779-f4ae-4a4a-b2cb-817d4f529525', 'volume_name': 'volume-d6170779-f4ae-4a4a-b2cb-817d4f529525', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1da289-0bce-4f52-b9ed-19e31b52e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1da289-0bce-4f52-b9ed-19e31b52e958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72271634-6727-4544-ae2c-b3cc2b46403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:50:58 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Volume d6170779-f4ae-4a4a-b2cb-817d4f529525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6170779-f4ae-4a4a-b2cb-817d4f529525', 'volume_size': 1} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-907050245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6170779-f4ae-4a4a-b2cb-817d4f529525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eaa0bd359a64dc789ecb1a8ae63c8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:50:59Z,use_quota=True,user_id='631a1a6e31fb47848d5d3e4ef9a1ac06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Creating volume d6170779-f4ae-4a4a-b2cb-817d4f529525 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:50:58 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:50:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:58 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 1073741824 Jun 12 04:50:58 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:50:59 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jun 12 04:50:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 1073741824" returned: 0 in 0.794s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:50:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:50:59 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 Jun 12 04:50:59 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:00 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525" returned: 0 in 0.627s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72271634-6727-4544-ae2c-b3cc2b46403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6170779-f4ae-4a4a-b2cb-817d4f529525', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695100eb-5cb8-4805-a800-11666f3b081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:00 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Volume volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 (d6170779-f4ae-4a4a-b2cb-817d4f529525): created successfully Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695100eb-5cb8-4805-a800-11666f3b081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Flow 'volume_create_manager' (7986b87a-951c-4054-8421-0c6b10b20489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8377285f-7243-4d1c-b7f7-145e94465ed9 tempest-VolumesActionsTest-1443418969 None] Created volume successfully. Jun 12 04:51:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Acquiring lock "cinder-d6170779-f4ae-4a4a-b2cb-817d4f529525-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Lock "cinder-d6170779-f4ae-4a4a-b2cb-817d4f529525-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Acquiring lock "cinder-quobyte-d6170779-f4ae-4a4a-b2cb-817d4f529525" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Lock "cinder-quobyte-d6170779-f4ae-4a4a-b2cb-817d4f529525" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:01 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b06c7-2c2a-486a-bc50-7e7955749093]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:01 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 Jun 12 04:51:01 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:02 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:02 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525 Jun 12 04:51:02 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:02 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d6170779-f4ae-4a4a-b2cb-817d4f529525" returned: 0 in 0.602s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Lock "cinder-quobyte-d6170779-f4ae-4a4a-b2cb-817d4f529525" released by "delete_volume" :: held 1.395s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Created reservations ['7b4af819-bfa2-4f66-98b7-43ac1cf50634', 'bf6f6e62-fd60-4c66-b1d6-d1ba8f803fcd', '2da46402-a92d-494b-a7f4-f7cf0aa22551', '0c506f60-7cfe-4f90-8c8c-b2a64aaf5612'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:03 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:51:03 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:03 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.591s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:51:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Deleted volume successfully. Jun 12 04:51:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-061ef1bf-3db7-474f-afa5-9bbcad519a1e tempest-VolumesActionsTest-1443418969 None] Lock "cinder-d6170779-f4ae-4a4a-b2cb-817d4f529525-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=46,cinder:UPDATE=76,cinder:INSERT=15,cinder:DELETE=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:51:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=55,cinder:UPDATE=63,cinder:INSERT=17,cinder:DELETE=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:51:18 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Flow 'volume_create_manager' (0b44606a-0000-4b1a-82c2-18bba9c88b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b29d52-4dd3-42e5-99b8-3fb9e699f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b29d52-4dd3-42e5-99b8-3fb9e699f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-546172299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5034facd-a951-4ec7-b318-3414aba2d03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1bb8d99f074e88bc9b489a4a1e14a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:19Z,use_quota=True,user_id='b9c7a403f0af4e0991a43af2bf1c3eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280538db-4d8b-4051-9005-3398acd89afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280538db-4d8b-4051-9005-3398acd89afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ac662e-0a44-4973-bf78-c54fdd2c4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ac662e-0a44-4973-bf78-c54fdd2c4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5034facd-a951-4ec7-b318-3414aba2d03c', 'volume_name': 'volume-5034facd-a951-4ec7-b318-3414aba2d03c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c328f822-d564-4fb0-ae40-d5f8956e5d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c328f822-d564-4fb0-ae40-d5f8956e5d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54056c15-f7ef-4756-8d68-4cfb36f4c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:19 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Volume 5034facd-a951-4ec7-b318-3414aba2d03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5034facd-a951-4ec7-b318-3414aba2d03c', 'volume_size': 1} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-546172299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5034facd-a951-4ec7-b318-3414aba2d03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1bb8d99f074e88bc9b489a4a1e14a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:19Z,use_quota=True,user_id='b9c7a403f0af4e0991a43af2bf1c3eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Creating volume 5034facd-a951-4ec7-b318-3414aba2d03c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:51:19 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:19 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c 1073741824 Jun 12 04:51:19 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:19 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c 1073741824" returned: 0 in 0.763s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:19 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c Jun 12 04:51:19 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:20 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c" returned: 0 in 0.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54056c15-f7ef-4756-8d68-4cfb36f4c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5034facd-a951-4ec7-b318-3414aba2d03c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a69fd64-6ecf-4987-a6d6-a4f8dafbca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:20 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Volume volume-5034facd-a951-4ec7-b318-3414aba2d03c (5034facd-a951-4ec7-b318-3414aba2d03c): created successfully Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a69fd64-6ecf-4987-a6d6-a4f8dafbca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Flow 'volume_create_manager' (0b44606a-0000-4b1a-82c2-18bba9c88b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:20 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f81e81bb-c781-49ee-8ee8-564b7fad03ca tempest-VolumesTransfersTest-748076118 None] Created volume successfully. Jun 12 04:51:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c0d924e9-e31d-4ca4-8064-602dac1e804f tempest-VolumesTransfersTest-770128262 None] Transfer volume completed successfully. Jun 12 04:51:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Acquiring lock "cinder-5034facd-a951-4ec7-b318-3414aba2d03c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-5034facd-a951-4ec7-b318-3414aba2d03c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Acquiring lock "cinder-quobyte-5034facd-a951-4ec7-b318-3414aba2d03c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-quobyte-5034facd-a951-4ec7-b318-3414aba2d03c" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2012f4b7-5ee5-4c37-a599-3aaeb5820ba3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:22 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c Jun 12 04:51:22 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:23 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c" returned: 0 in 0.698s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:23 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c Jun 12 04:51:23 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:23 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5034facd-a951-4ec7-b318-3414aba2d03c" returned: 0 in 0.591s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-quobyte-5034facd-a951-4ec7-b318-3414aba2d03c" released by "delete_volume" :: held 1.335s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Created reservations ['eb8aba66-568c-40c9-9ce8-9965ed746f01', '4e6054f8-29a0-4cf1-9704-75897e0f4b91', '305aaef0-daa0-45af-a490-cc7e59248284', '4eb99c24-5141-4114-9f4f-6cd6b0868284'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:23 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:51:23 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:24 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:24 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:51:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Deleted volume successfully. Jun 12 04:51:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09e87cc1-3a27-47ff-a6d6-21c1af7688d8 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-5034facd-a951-4ec7-b318-3414aba2d03c-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Flow 'volume_create_manager' (faf61095-7d6d-45ef-8dea-8f2dada37f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2d205d-1be9-42e4-bfae-9b17b2c241ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2d205d-1be9-42e4-bfae-9b17b2c241ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1508401995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bba4d6-f4c6-4c14-903a-91cfff9af40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1bb8d99f074e88bc9b489a4a1e14a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:25Z,use_quota=True,user_id='b9c7a403f0af4e0991a43af2bf1c3eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3216b7a0-90b7-4291-825f-ed2f4f2b9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3216b7a0-90b7-4291-825f-ed2f4f2b9327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921b1b3c-de1b-4756-8f28-7141d5eaa189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921b1b3c-de1b-4756-8f28-7141d5eaa189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6bba4d6-f4c6-4c14-903a-91cfff9af40b', 'volume_name': 'volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1f96a7-56b6-4b37-9ee1-ab6fb0f5f92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1f96a7-56b6-4b37-9ee1-ab6fb0f5f92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2636ab82-fd3c-407b-9743-c5d6fbc1b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:25 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Volume c6bba4d6-f4c6-4c14-903a-91cfff9af40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b', 'volume_size': 1} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1508401995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bba4d6-f4c6-4c14-903a-91cfff9af40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea1bb8d99f074e88bc9b489a4a1e14a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:25Z,use_quota=True,user_id='b9c7a403f0af4e0991a43af2bf1c3eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Creating volume c6bba4d6-f4c6-4c14-903a-91cfff9af40b {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:51:25 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:25 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b 1073741824 Jun 12 04:51:25 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:25 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b 1073741824" returned: 0 in 0.764s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:26 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b Jun 12 04:51:26 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:26 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b" returned: 0 in 0.653s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2636ab82-fd3c-407b-9743-c5d6fbc1b250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949cbc36-d7aa-4e6a-afb0-02d21b879da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:26 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Volume volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b (c6bba4d6-f4c6-4c14-903a-91cfff9af40b): created successfully Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949cbc36-d7aa-4e6a-afb0-02d21b879da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Flow 'volume_create_manager' (faf61095-7d6d-45ef-8dea-8f2dada37f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9664be70-5cb0-4220-93c9-4117210bbf2f tempest-VolumesTransfersTest-748076118 None] Created volume successfully. Jun 12 04:51:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Acquiring lock "cinder-c6bba4d6-f4c6-4c14-903a-91cfff9af40b-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-c6bba4d6-f4c6-4c14-903a-91cfff9af40b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Acquiring lock "cinder-quobyte-c6bba4d6-f4c6-4c14-903a-91cfff9af40b" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-quobyte-c6bba4d6-f4c6-4c14-903a-91cfff9af40b" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:27 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bce83c9-a1df-4212-b073-e57a5b7627e8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:27 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b Jun 12 04:51:27 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:28 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b" returned: 0 in 0.712s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:28 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b Jun 12 04:51:28 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:28 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c6bba4d6-f4c6-4c14-903a-91cfff9af40b" returned: 0 in 0.589s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-quobyte-c6bba4d6-f4c6-4c14-903a-91cfff9af40b" released by "delete_volume" :: held 1.346s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:28 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Created reservations ['29af1ac7-5141-472a-a63e-4fdbbcdfb169', 'e73ea61f-4b37-458b-97c3-b789e7edd266', 'f0233e66-1600-4cd9-ab4c-d36de81bb83c', 'ce5d8678-68af-4044-b1c8-b09ac2fa5148'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:29 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:51:29 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:29 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:51:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Deleted volume successfully. Jun 12 04:51:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a155590f-f7b6-4178-a6f4-42afa0fcfdf5 tempest-VolumesTransfersTest-2073239988 None] Lock "cinder-c6bba4d6-f4c6-4c14-903a-91cfff9af40b-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Flow 'volume_create_manager' (7b8d767a-074f-4797-8f82-deaa1ee70c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6708c7e-a7e6-4bec-a21b-dcd3e1207788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6708c7e-a7e6-4bec-a21b-dcd3e1207788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-629043692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd1a4e5-5e5e-4405-b25b-006c26c2661a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da9ffc459541a98e75ad67c062e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:31Z,use_quota=True,user_id='19aee15328234c81b9eb14943f7a29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231f3a9b-73bc-4601-8607-0342670958f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231f3a9b-73bc-4601-8607-0342670958f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06e2f93-33b9-4157-9b8d-06989b01e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06e2f93-33b9-4157-9b8d-06989b01e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd1a4e5-5e5e-4405-b25b-006c26c2661a', 'volume_name': 'volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfbf594-3eac-4ed3-a1a3-5359c755e939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfbf594-3eac-4ed3-a1a3-5359c755e939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a13942-4a2b-4feb-978b-72352239a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:31 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Volume 6dd1a4e5-5e5e-4405-b25b-006c26c2661a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a', 'volume_size': 1} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-629043692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd1a4e5-5e5e-4405-b25b-006c26c2661a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da9ffc459541a98e75ad67c062e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:31Z,use_quota=True,user_id='19aee15328234c81b9eb14943f7a29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Creating volume 6dd1a4e5-5e5e-4405-b25b-006c26c2661a {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:51:31 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:31 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a 1073741824 Jun 12 04:51:31 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:31 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:51:31 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:32 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a 1073741824" returned: 0 in 0.860s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:32 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a Jun 12 04:51:32 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:32 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.707s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:51:32 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" returned: 0 in 0.649s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a13942-4a2b-4feb-978b-72352239a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23820627-5ef5-4a78-8558-cb6a2368dcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Volume volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a (6dd1a4e5-5e5e-4405-b25b-006c26c2661a): created successfully Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23820627-5ef5-4a78-8558-cb6a2368dcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Flow 'volume_create_manager' (7b8d767a-074f-4797-8f82-deaa1ee70c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:32 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-685ad1b3-b1d5-4ef3-8c4b-93c7eb2f5567 tempest-AttachVolumeNegativeTest-522445774 None] Created volume successfully. Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Flow 'volume_create_manager' (1b89f197-1de6-44c8-8d2d-8d410ef10c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76800ce2-7d75-4669-8eb0-7401ff01d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76800ce2-7d75-4669-8eb0-7401ff01d632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-764075756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2793af2-31f1-475b-afc7-86a8b0291cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae53a3f6698c450385c30222318adfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:35Z,use_quota=True,user_id='5c288783495a436ca0e6122975f8e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67966ec5-90ce-4ecf-8ebe-629f450ebe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67966ec5-90ce-4ecf-8ebe-629f450ebe48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e975ed-18d3-49f8-8cc8-ca1156a7c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e975ed-18d3-49f8-8cc8-ca1156a7c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2793af2-31f1-475b-afc7-86a8b0291cae', 'volume_name': 'volume-a2793af2-31f1-475b-afc7-86a8b0291cae', 'volume_size': 2}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4892a66-863f-4eaf-a157-52f911c3489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4892a66-863f-4eaf-a157-52f911c3489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad5e0bf-446e-4ce9-b2a3-04d292c762b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Volume a2793af2-31f1-475b-afc7-86a8b0291cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2793af2-31f1-475b-afc7-86a8b0291cae', 'volume_size': 2} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-764075756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2793af2-31f1-475b-afc7-86a8b0291cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae53a3f6698c450385c30222318adfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:35Z,use_quota=True,user_id='5c288783495a436ca0e6122975f8e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Creating volume a2793af2-31f1-475b-afc7-86a8b0291cae {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:51:34 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:51:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae 2147483648 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:34 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae 2147483648 Jun 12 04:51:34 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:35 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae 2147483648" returned: 0 in 0.789s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:35 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae Jun 12 04:51:35 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:36 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad5e0bf-446e-4ce9-b2a3-04d292c762b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2793af2-31f1-475b-afc7-86a8b0291cae', 'volume_size': 2}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244d5f77-dce3-438b-ade2-40e3365814a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Volume volume-a2793af2-31f1-475b-afc7-86a8b0291cae (a2793af2-31f1-475b-afc7-86a8b0291cae): created successfully Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244d5f77-dce3-438b-ade2-40e3365814a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Flow 'volume_create_manager' (1b89f197-1de6-44c8-8d2d-8d410ef10c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1e79dfbb-db8c-48c2-abfe-2ac0407b274a tempest-VolumesCloneNegativeTest-177022985 None] Created volume successfully. Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064091c-3894-4eff-a5bc-e1a6a1168576]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:36 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a Jun 12 04:51:36 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Acquiring lock "cinder-a2793af2-31f1-475b-afc7-86a8b0291cae-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Lock "cinder-a2793af2-31f1-475b-afc7-86a8b0291cae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Acquiring lock "cinder-quobyte-a2793af2-31f1-475b-afc7-86a8b0291cae" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Lock "cinder-quobyte-a2793af2-31f1-475b-afc7-86a8b0291cae" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253803c-7c63-4faa-a030-44f2dbb85a94]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:37 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae Jun 12 04:51:37 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:37 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" returned: 0 in 0.724s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.741s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a89e4327-13d6-43ae-959d-01692c575661', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:51:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-b006d86a-ca02-4f51-b81c-89de5dadd618 req-7d00ba62-cb1b-4f39-ba35-d7235d56d7c2 tempest-AttachVolumeNegativeTest-522445774 None] attachment_update completed successfully. Jun 12 04:51:37 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae" returned: 0 in 0.743s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:37 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae Jun 12 04:51:37 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:38 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a2793af2-31f1-475b-afc7-86a8b0291cae" returned: 0 in 0.597s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Lock "cinder-quobyte-a2793af2-31f1-475b-afc7-86a8b0291cae" released by "delete_volume" :: held 1.381s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Created reservations ['11918db4-6616-46e3-86f1-0231e2817c15', 'fadeb987-574e-4053-afe0-600ddf3b7f85', 'd4a1e736-634a-4f05-9506-146872c5ea91', 'ed32a510-2f97-46e1-92b0-6676f4653c53'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:38 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:51:38 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:39 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:39 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:51:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Deleted volume successfully. Jun 12 04:51:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cca3ce3a-74f6-483f-aeb0-79a3123bc6fe tempest-VolumesCloneNegativeTest-177022985 None] Lock "cinder-a2793af2-31f1-475b-afc7-86a8b0291cae-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Flow 'volume_create_manager' (47344d1e-2ac0-401b-8a71-23c82841b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71438c02-0ba0-4cea-8ade-f9767ec56abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71438c02-0ba0-4cea-8ade-f9767ec56abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1216393197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5587b84-0598-422b-974d-f459e081417e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e538042b2ad44b579c97af2a2f76fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:42Z,use_quota=True,user_id='5d2fdff8a25d4d42b89800b62a78f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33babc7e-ddf3-4c57-8346-2ae93e2761c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33babc7e-ddf3-4c57-8346-2ae93e2761c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5273c707-6500-4e63-904c-66af14be522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5273c707-6500-4e63-904c-66af14be522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5587b84-0598-422b-974d-f459e081417e', 'volume_name': 'volume-c5587b84-0598-422b-974d-f459e081417e', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38046482-b0cf-4956-b52a-903d0f606b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38046482-b0cf-4956-b52a-903d0f606b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074b1d08-643c-430a-92f5-9b533fa7bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:41 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Volume c5587b84-0598-422b-974d-f459e081417e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5587b84-0598-422b-974d-f459e081417e', 'volume_size': 1} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1216393197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5587b84-0598-422b-974d-f459e081417e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e538042b2ad44b579c97af2a2f76fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:51:42Z,use_quota=True,user_id='5d2fdff8a25d4d42b89800b62a78f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Creating volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:51:41 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:51:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:41 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e 1073741824 Jun 12 04:51:41 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:42 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e 1073741824" returned: 0 in 0.797s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:42 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e Jun 12 04:51:42 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:43 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e" returned: 0 in 0.600s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074b1d08-643c-430a-92f5-9b533fa7bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5587b84-0598-422b-974d-f459e081417e', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e0d49d-b681-4d19-b7f2-d56c62c54ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:51:43 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Volume volume-c5587b84-0598-422b-974d-f459e081417e (c5587b84-0598-422b-974d-f459e081417e): created successfully Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e0d49d-b681-4d19-b7f2-d56c62c54ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Flow 'volume_create_manager' (47344d1e-2ac0-401b-8a71-23c82841b244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:51:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-48211b2d-7ed4-42ed-bf2b-c39d23a55a8d tempest-VolumesSnapshotListTestJSON-1149609912 None] Created volume successfully. Jun 12 04:51:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-561a504a-0cdd-4376-b7bb-3ad9bdc5b6a8 req-77b31d36-baf7-4b13-b8df-6e2931fe8a84 tempest-AttachVolumeNegativeTest-522445774 None] Terminate volume connection completed successfully. Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-561a504a-0cdd-4376-b7bb-3ad9bdc5b6a8 req-77b31d36-baf7-4b13-b8df-6e2931fe8a84 tempest-AttachVolumeNegativeTest-522445774 None] Deleting attachment a89e4327-13d6-43ae-959d-01692c575661. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Creating offline snapshot 65e2b1bd-6562-436a-9b37-2e8774748970 of volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[58390bf3-f0b9-4fc2-af78-02ef216f97d4]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:44 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e Jun 12 04:51:44 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:44 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e" returned: 0 in 0.699s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:44 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 1G Jun 12 04:51:44 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:45 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 1G" returned: 0 in 0.768s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:45 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:51:45 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:46 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.639s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:46 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 is being set with open permissions: ugo+rw Jun 12 04:51:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:46 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:51:46 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:46 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.692s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:46 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info Jun 12 04:51:46 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:47 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info" returned: 0 in 0.607s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:47 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info is being set with open permissions: ugo+rw Jun 12 04:51:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:47 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info Jun 12 04:51:47 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:48 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.info" returned: 0 in 0.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.123s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:48 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e27903ec-f223-4f61-8b69-820d6b6cb21f tempest-VolumesSnapshotListTestJSON-1149609912 None] Create snapshot completed successfully Jun 12 04:51:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Creating offline snapshot 8f293423-c27a-4c13-bf9d-0c7545ea868a of volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:51:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6721572-89dc-434b-b5e3-5c18efacf270]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:49 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:51:49 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:50 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.703s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:51:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:50 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a 1G Jun 12 04:51:50 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:50 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a 1G" returned: 0 in 0.776s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:50 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:51:50 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:51 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.630s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:51 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a is being set with open permissions: ugo+rw Jun 12 04:51:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:51 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:51:51 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:52 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-bc722f51-84c9-4ff6-87b7-bda283702d4f tempest-VolumesSnapshotListTestJSON-1149609912 None] Create snapshot completed successfully Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Creating offline snapshot 3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 of volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[794faf56-7b70-4cee-8d39-f29e8dc32214]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:52 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:51:52 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:53 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:51:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:53 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 1G Jun 12 04:51:53 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:54 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 1G" returned: 0 in 0.883s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:54 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 Jun 12 04:51:54 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:54 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" returned: 0 in 0.651s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:54 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 is being set with open permissions: ugo+rw Jun 12 04:51:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:54 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 Jun 12 04:51:54 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:55 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" returned: 0 in 0.581s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:51:55 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-03021b54-3791-4e83-a94c-05cfe8473eb9 tempest-VolumesSnapshotListTestJSON-1149609912 None] Create snapshot completed successfully Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-3a9d93c1-c0ff-453c-ab2e-e5c6242329d5-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-3a9d93c1-c0ff-453c-ab2e-e5c6242329d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Deleting offline snapshot 3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 of volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] snapshot_file for this snap is: volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e521d25-f337-46f9-938d-745440656aaf]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:56 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 Jun 12 04:51:56 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:57 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" returned: 0 in 0.722s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:51:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e12181-3c01-4f5e-9ffc-95853b0e0c7d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:57 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:51:57 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:58 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.729s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:51:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:58 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 Jun 12 04:51:58 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:58 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" returned: 0 in 0.768s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:58 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5 Jun 12 04:51:58 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:51:59 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" returned: 0 in 0.576s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-3a9d93c1-c0ff-453c-ab2e-e5c6242329d5" released by "_delete_snapshot" :: held 2.895s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" released by "delete_snapshot" :: held 2.918s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Created reservations ['ef1bce9f-b6c7-47c5-9c46-8f4aa9449f4b', '4ef0ce89-3819-4952-aeee-2aac0590d173', '15311ff2-a76a-42b7-bc43-ad550eb4fb67', 'c77b82f6-ad0e-4091-ac6e-a6ea85199ec6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:51:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Delete snapshot completed successfully. Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e3146f0-6cdf-4f62-9fec-40660e943f6a tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-3a9d93c1-c0ff-453c-ab2e-e5c6242329d5-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-8f293423-c27a-4c13-bf9d-0c7545ea868a-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-8f293423-c27a-4c13-bf9d-0c7545ea868a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-8f293423-c27a-4c13-bf9d-0c7545ea868a" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-8f293423-c27a-4c13-bf9d-0c7545ea868a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Deleting offline snapshot 8f293423-c27a-4c13-bf9d-0c7545ea868a of volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] snapshot_file for this snap is: volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7f9ec-0c69-48b9-afca-65fbd1d48a58]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:51:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:51:59 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:51:59 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:00 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.717s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:52:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa73d64a-22d9-43e2-b7e9-f91e87351ab9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:00 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:52:00 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:01 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.755s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:52:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:01 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:52:01 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:02 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.840s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:02 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a Jun 12 04:52:02 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:02 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.8f293423-c27a-4c13-bf9d-0c7545ea868a" returned: 0 in 0.670s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-8f293423-c27a-4c13-bf9d-0c7545ea868a" released by "_delete_snapshot" :: held 3.075s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" released by "delete_snapshot" :: held 3.100s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Created reservations ['80473197-b436-409a-8d30-78addc674d9e', 'e7fde312-a477-4173-af97-b7b71ad7c9a4', '56d21894-5fa1-4222-85fa-5e29d1820fe5', '6eed99fe-c22f-4336-9310-8d591efb3864'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Delete snapshot completed successfully. Jun 12 04:52:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ebae8531-1ece-4f00-9a37-35e9fca241a5 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-8f293423-c27a-4c13-bf9d-0c7545ea868a-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-65e2b1bd-6562-436a-9b37-2e8774748970-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-65e2b1bd-6562-436a-9b37-2e8774748970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-65e2b1bd-6562-436a-9b37-2e8774748970" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-65e2b1bd-6562-436a-9b37-2e8774748970" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Deleting offline snapshot 65e2b1bd-6562-436a-9b37-2e8774748970 of volume c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:52:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] snapshot_file for this snap is: volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:52:04 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a125c1-d8bd-4c8a-86b4-ee61d528760c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:04 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:52:04 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:04 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.743s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5587b84-0598-422b-974d-f459e081417e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:52:04 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c59a9-2aba-4d41-8bad-9a73db084914]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:04 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e Jun 12 04:52:04 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:05 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e" returned: 0 in 0.735s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:05 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:52:05 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:06 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.703s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:06 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970 Jun 12 04:52:06 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:06 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e.65e2b1bd-6562-436a-9b37-2e8774748970" returned: 0 in 0.587s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-65e2b1bd-6562-436a-9b37-2e8774748970" released by "_delete_snapshot" :: held 2.893s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" released by "delete_snapshot" :: held 2.915s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Created reservations ['8013c37f-6a07-4177-96e9-0812c991a8ef', '1198314c-1e7e-4202-add2-18454549d3cb', '9821a589-d75f-4784-be97-46b4c5ad5f0e', '4e57491a-dde2-427f-a287-7ae61614adb2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Delete snapshot completed successfully. Jun 12 04:52:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbeccd2d-d32b-4437-923d-dc16a87f7971 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-65e2b1bd-6562-436a-9b37-2e8774748970-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:07 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-c5587b84-0598-422b-974d-f459e081417e-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:07 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-c5587b84-0598-422b-974d-f459e081417e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:07 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:07 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:07 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b35bf-3b08-4f77-9988-96d02f6f846a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:07 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e Jun 12 04:52:07 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:08 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e" returned: 0 in 0.973s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:08 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e Jun 12 04:52:08 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:08 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c5587b84-0598-422b-974d-f459e081417e" returned: 0 in 0.744s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:08 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-quobyte-c5587b84-0598-422b-974d-f459e081417e" released by "delete_volume" :: held 1.778s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Created reservations ['1651c04d-9d8b-4a26-ad9c-71b49c8e67e5', 'b9a1fbb2-54df-4c17-88f3-284920bfd5ed', '348e9e25-77e9-4dad-a45c-4c50f5f16128', 'cba1585a-0e65-4030-9382-73edde88390c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:09 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:52:09 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:09 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:52:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Deleted volume successfully. Jun 12 04:52:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e29da580-655f-44f7-97b8-5775bd2c2fd2 tempest-VolumesSnapshotListTestJSON-1149609912 None] Lock "cinder-c5587b84-0598-422b-974d-f459e081417e-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Flow 'volume_create_manager' (3a684eb4-656d-4ce9-8136-635c741c1b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0b7b46-4e6d-435a-bd79-7e02cb3c5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0b7b46-4e6d-435a-bd79-7e02cb3c5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1668899237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f55307-d7f7-47a3-81d5-37c3ad8de8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315513df444e4d6cb9aaa1ccc88234bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:13Z,use_quota=True,user_id='cbd928e0c90a444ea26b4f7dd622b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a595a436-d861-432e-aaa9-abd183d0152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a595a436-d861-432e-aaa9-abd183d0152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27964f-b742-4432-9a40-a02550da33f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27964f-b742-4432-9a40-a02550da33f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f55307-d7f7-47a3-81d5-37c3ad8de8f2', 'volume_name': 'volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2', 'volume_size': 2}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3129dcca-525a-4ea9-9205-904a916e67f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3129dcca-525a-4ea9-9205-904a916e67f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae093433-7370-42e1-a42e-cf9de8b40e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Volume 06f55307-d7f7-47a3-81d5-37c3ad8de8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2', 'volume_size': 2} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1668899237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f55307-d7f7-47a3-81d5-37c3ad8de8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315513df444e4d6cb9aaa1ccc88234bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:13Z,use_quota=True,user_id='cbd928e0c90a444ea26b4f7dd622b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Creating volume 06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:52:12 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:52:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 2147483648 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:12 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 2147483648 Jun 12 04:52:12 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:13 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 2147483648" returned: 0 in 1.001s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=74,cinder:SELECT=64,cinder:INSERT=14,cinder:DELETE=11 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:52:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=62,cinder:UPDATE=66,cinder:INSERT=20,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:52:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:14 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 Jun 12 04:52:14 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:14 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" returned: 0 in 0.680s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae093433-7370-42e1-a42e-cf9de8b40e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2', 'volume_size': 2}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d625d8-2b1c-45f7-b8b8-6e8d744ea80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:14 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Volume volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 (06f55307-d7f7-47a3-81d5-37c3ad8de8f2): created successfully Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d625d8-2b1c-45f7-b8b8-6e8d744ea80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Flow 'volume_create_manager' (3a684eb4-656d-4ce9-8136-635c741c1b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-be4e98c5-6bc4-4a45-a03b-6a3758eb9677 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Created volume successfully. Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Creating offline snapshot f868318b-ab81-4b42-8f2a-c7e43baed52f of volume 06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3061b47d-beaa-4030-b0fd-4b25053c0123]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:15 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 Jun 12 04:52:15 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:15 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" returned: 0 in 0.744s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f 2G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:15 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f 2G Jun 12 04:52:15 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:16 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f 2G" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:16 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f Jun 12 04:52:16 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:17 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f" returned: 0 in 0.663s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:17 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f is being set with open permissions: ugo+rw Jun 12 04:52:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:17 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f Jun 12 04:52:17 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:17 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:17 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info Jun 12 04:52:17 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:18 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info" returned: 0 in 0.587s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:18 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info is being set with open permissions: ugo+rw Jun 12 04:52:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:18 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info Jun 12 04:52:18 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:19 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.info" returned: 0 in 0.569s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.981s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c9996fc2-8268-40c4-8291-4d4195b34991 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Create snapshot completed successfully Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "cinder-f868318b-ab81-4b42-8f2a-c7e43baed52f-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-f868318b-ab81-4b42-8f2a-c7e43baed52f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "cinder-quobyte-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-quobyte-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "cinder-quobyte-f868318b-ab81-4b42-8f2a-c7e43baed52f" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-quobyte-f868318b-ab81-4b42-8f2a-c7e43baed52f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Deleting offline snapshot f868318b-ab81-4b42-8f2a-c7e43baed52f of volume 06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] snapshot_file for this snap is: volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb021521-43be-45e2-9505-ba018e8a178c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:19 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f Jun 12 04:52:19 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:20 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f" returned: 0 in 0.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:52:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c832a-f875-47e6-ba4c-6baa2ec7be5c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:20 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 Jun 12 04:52:20 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:20 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" returned: 0 in 0.701s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:20 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f Jun 12 04:52:20 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:21 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f" returned: 0 in 0.655s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:21 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f Jun 12 04:52:21 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:22 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2.f868318b-ab81-4b42-8f2a-c7e43baed52f" returned: 0 in 0.568s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-quobyte-f868318b-ab81-4b42-8f2a-c7e43baed52f" released by "_delete_snapshot" :: held 2.706s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-quobyte-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" released by "delete_snapshot" :: held 2.729s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Created reservations ['d605e90e-e0be-4c46-8e88-df8d2fe745ac', '62a5e0e7-87a0-4272-9b53-2a1447c728f5', '45b16c1c-5658-4ebc-9b1c-95ea8b1f4b14', '1d21dbf9-17c0-4637-afb7-e245f5c433bd'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Delete snapshot completed successfully. Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-346036ba-0a9c-4b69-a177-e82362103458 tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-f868318b-ab81-4b42-8f2a-c7e43baed52f-delete_snapshot" released by "delete_snapshot" :: held 2.846s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "cinder-06f55307-d7f7-47a3-81d5-37c3ad8de8f2-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-06f55307-d7f7-47a3-81d5-37c3ad8de8f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "cinder-quobyte-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-quobyte-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec771df6-1820-461c-bd08-c10da34dbcd8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:22 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 Jun 12 04:52:22 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:23 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" returned: 0 in 0.690s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:23 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2 Jun 12 04:52:23 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:24 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" returned: 0 in 0.576s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-quobyte-06f55307-d7f7-47a3-81d5-37c3ad8de8f2" released by "delete_volume" :: held 1.324s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Created reservations ['038a68f3-73d8-4912-bf33-e2501297ed97', 'e5b1ebec-0ef9-44d3-8541-b0463d581cdf', 'f7b27a89-48ea-47f9-b479-1166ebc9a003', '447f59fe-e335-4fce-b596-8dd853260aa3'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:24 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:52:24 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:24 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.572s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:52:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Deleted volume successfully. Jun 12 04:52:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0d219a63-9271-48cb-960e-e2c232ddf40c tempest-VolumesSnapshotNegativeTestJSON-112146252 None] Lock "cinder-06f55307-d7f7-47a3-81d5-37c3ad8de8f2-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:31 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:52:31 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:32 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.606s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:52:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:52:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:52:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Flow 'volume_create_manager' (539396d3-6da1-4326-ae63-6d16b604bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65b60a0-411b-41a9-85be-04ab1e5d92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65b60a0-411b-41a9-85be-04ab1e5d92f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-610225378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc660f7c-1a5e-4009-8f08-ae611a1a7c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da9ffc459541a98e75ad67c062e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:33Z,use_quota=True,user_id='19aee15328234c81b9eb14943f7a29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78714160-5df9-4dc8-934d-cb16ef5a320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78714160-5df9-4dc8-934d-cb16ef5a320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc57d7c-f70f-4bbb-8786-d1eaf2eb28f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc57d7c-f70f-4bbb-8786-d1eaf2eb28f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc660f7c-1a5e-4009-8f08-ae611a1a7c34', 'volume_name': 'volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edaaa454-c61c-44c0-9449-fc6c70d9abf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edaaa454-c61c-44c0-9449-fc6c70d9abf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c9d298-d23b-49cd-8270-350550ea4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:33 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Volume cc660f7c-1a5e-4009-8f08-ae611a1a7c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34', 'volume_size': 1} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-610225378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc660f7c-1a5e-4009-8f08-ae611a1a7c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da9ffc459541a98e75ad67c062e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:33Z,use_quota=True,user_id='19aee15328234c81b9eb14943f7a29ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Creating volume cc660f7c-1a5e-4009-8f08-ae611a1a7c34 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:52:33 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:52:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:33 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 1073741824 Jun 12 04:52:33 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:34 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 1073741824" returned: 0 in 0.839s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:34 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 Jun 12 04:52:34 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:34 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" returned: 0 in 0.642s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c9d298-d23b-49cd-8270-350550ea4dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51198e74-7396-439f-8965-7b38f629fd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Volume volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 (cc660f7c-1a5e-4009-8f08-ae611a1a7c34): created successfully Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51198e74-7396-439f-8965-7b38f629fd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Flow 'volume_create_manager' (539396d3-6da1-4326-ae63-6d16b604bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b15d8dd1-677a-4829-b7fe-ae3428744efb tempest-AttachVolumeNegativeTest-522445774 None] Created volume successfully. Jun 12 04:52:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:38 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fdd97e-9a07-4403-866a-b22e37d4a1f1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:38 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 Jun 12 04:52:38 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:39 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7ccdf6f-2010-4703-8276-cc13fee0b559', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:52:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-d9ddbe69-a134-410f-a75d-169f10fe2d14 req-461514d6-64cb-45d9-bdac-3d3018041db5 tempest-AttachVolumeNegativeTest-522445774 None] attachment_update completed successfully. Jun 12 04:52:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-9188d2d3-fefc-4264-9f08-3de45f95c305 req-9b53107c-0b53-4131-aa7b-891ce5227772 tempest-AttachVolumeNegativeTest-522445774 None] Terminate volume connection completed successfully. Jun 12 04:52:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-9188d2d3-fefc-4264-9f08-3de45f95c305 req-9b53107c-0b53-4131-aa7b-891ce5227772 tempest-AttachVolumeNegativeTest-522445774 None] Deleting attachment c7ccdf6f-2010-4703-8276-cc13fee0b559. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Flow 'volume_create_manager' (146a1e63-9f4a-4c2f-b0d4-151da1bb6c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9a598f-43a1-45bd-a259-718186fb85e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9a598f-43a1-45bd-a259-718186fb85e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-797629905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935e1b64-ad79-4573-811d-5fe7575cebdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83dc735d3b047a3ac11f7d38203d996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:48Z,use_quota=True,user_id='c0ebf02e8e294aaba280ea45ba423813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7651c57-93b2-4f5a-96d0-b27b89a0d0da),volume_type_id=b7651c57-93b2-4f5a-96d0-b27b89a0d0da)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc8834-465f-4de0-b7ec-f43a66b46b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc8834-465f-4de0-b7ec-f43a66b46b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e889c4-45c4-4bb4-bbd8-f962741dc7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e889c4-45c4-4bb4-bbd8-f962741dc7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935e1b64-ad79-4573-811d-5fe7575cebdf', 'volume_name': 'volume-935e1b64-ad79-4573-811d-5fe7575cebdf', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddda1746-474b-4334-b86e-70eaddf60875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddda1746-474b-4334-b86e-70eaddf60875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8394ed55-736c-4842-a12f-a745a49d7068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume 935e1b64-ad79-4573-811d-5fe7575cebdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935e1b64-ad79-4573-811d-5fe7575cebdf', 'volume_size': 1} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-797629905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935e1b64-ad79-4573-811d-5fe7575cebdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83dc735d3b047a3ac11f7d38203d996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:48Z,use_quota=True,user_id='c0ebf02e8e294aaba280ea45ba423813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7651c57-93b2-4f5a-96d0-b27b89a0d0da),volume_type_id=b7651c57-93b2-4f5a-96d0-b27b89a0d0da)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Creating volume 935e1b64-ad79-4573-811d-5fe7575cebdf {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:52:48 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:48 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf 1073741824 Jun 12 04:52:48 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Flow 'volume_create_manager' (d3f8f0df-dbe0-4e13-9d81-a0b88447d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c827b37b-b2eb-4f63-a5c9-adc96f5f2cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c827b37b-b2eb-4f63-a5c9-adc96f5f2cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2089799654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26032432-ad3a-457a-923a-59070ec7da7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83dc735d3b047a3ac11f7d38203d996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:49Z,use_quota=True,user_id='c0ebf02e8e294aaba280ea45ba423813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb22b32d-6a1a-443b-9342-f8ca98bb46b2),volume_type_id=eb22b32d-6a1a-443b-9342-f8ca98bb46b2)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f28bea-ba3b-4f4b-ab66-ffd93011cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f28bea-ba3b-4f4b-ab66-ffd93011cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5627df-055a-4c53-9255-f65856fa5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5627df-055a-4c53-9255-f65856fa5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26032432-ad3a-457a-923a-59070ec7da7c', 'volume_name': 'volume-26032432-ad3a-457a-923a-59070ec7da7c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c0ce43-ee08-4842-ab09-e96e2ceca202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c0ce43-ee08-4842-ab09-e96e2ceca202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387ffb3d-7b0d-40f8-984c-cc55d69dc7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:48 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume 26032432-ad3a-457a-923a-59070ec7da7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26032432-ad3a-457a-923a-59070ec7da7c', 'volume_size': 1} Jun 12 04:52:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:49 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf 1073741824" returned: 0 in 1.108s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Flow 'volume_create_manager' (a4305372-021d-4b83-938e-74876f897c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dae55e-561e-454f-88f8-48996a70e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dae55e-561e-454f-88f8-48996a70e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-909518160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1864c4a9-6b41-418b-921b-794823122206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83dc735d3b047a3ac11f7d38203d996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:49Z,use_quota=True,user_id='c0ebf02e8e294aaba280ea45ba423813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a5412ab-bbb3-46bc-bcc3-0d294f49286c),volume_type_id=5a5412ab-bbb3-46bc-bcc3-0d294f49286c)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f930c9-58ed-40ee-a764-3b7e4e6b0f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:49 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf Jun 12 04:52:49 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f930c9-58ed-40ee-a764-3b7e4e6b0f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb193e7-a7ff-4efd-bf0b-2ff877bfa22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb193e7-a7ff-4efd-bf0b-2ff877bfa22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1864c4a9-6b41-418b-921b-794823122206', 'volume_name': 'volume-1864c4a9-6b41-418b-921b-794823122206', 'volume_size': 1, 'image_id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1345484360', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b83dc735d3b047a3ac11f7d38203d996', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'created_at': datetime.datetime(2026, 6, 12, 2, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529/file', 'properties': {}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b42f212-cdf8-4073-a3e6-80034badd4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b42f212-cdf8-4073-a3e6-80034badd4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d81160-e95e-4289-880f-4af99630dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:49 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume 1864c4a9-6b41-418b-921b-794823122206: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1864c4a9-6b41-418b-921b-794823122206', 'volume_size': 1, 'image_id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1345484360', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b83dc735d3b047a3ac11f7d38203d996', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'created_at': datetime.datetime(2026, 6, 12, 2, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529/file', 'properties': {}}, 'image_service': } Jun 12 04:52:49 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Trying to clone 1864c4a9-6b41-418b-921b-794823122206 from image 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 04:52:50 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf" returned: 0 in 0.813s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2089799654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26032432-ad3a-457a-923a-59070ec7da7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83dc735d3b047a3ac11f7d38203d996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:49Z,use_quota=True,user_id='c0ebf02e8e294aaba280ea45ba423813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb22b32d-6a1a-443b-9342-f8ca98bb46b2),volume_type_id=eb22b32d-6a1a-443b-9342-f8ca98bb46b2)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Creating volume 26032432-ad3a-457a-923a-59070ec7da7c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:52:50 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:50 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c 1073741824 Jun 12 04:52:50 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8394ed55-736c-4842-a12f-a745a49d7068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935e1b64-ad79-4573-811d-5fe7575cebdf', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc06c81a-8b66-4981-9ec5-eeba2ae0fdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:50 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume volume-935e1b64-ad79-4573-811d-5fe7575cebdf (935e1b64-ad79-4573-811d-5fe7575cebdf): created successfully Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc06c81a-8b66-4981-9ec5-eeba2ae0fdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Flow 'volume_create_manager' (146a1e63-9f4a-4c2f-b0d4-151da1bb6c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:50 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9c5592c9-207e-4933-b776-9cb6b356e86a tempest-TestInstancesWithCinderVolumes-1519388260 None] Created volume successfully. Jun 12 04:52:51 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c 1073741824" returned: 0 in 0.884s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:51 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c Jun 12 04:52:51 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:51 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c" returned: 0 in 0.596s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387ffb3d-7b0d-40f8-984c-cc55d69dc7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26032432-ad3a-457a-923a-59070ec7da7c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f33a7-3668-4ca4-8607-1a28b313587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:52:51 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume volume-26032432-ad3a-457a-923a-59070ec7da7c (26032432-ad3a-457a-923a-59070ec7da7c): created successfully Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f33a7-3668-4ca4-8607-1a28b313587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:52:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Flow 'volume_create_manager' (d3f8f0df-dbe0-4e13-9d81-a0b88447d821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:52:51 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7106a3d4-ff16-4a6a-89ad-88a1854653fa tempest-TestInstancesWithCinderVolumes-1519388260 None] Created volume successfully. Jun 12 04:52:53 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD, size 20.69 MB, duration 3.34 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 04:52:53 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Image download 20.69 MB at 6.20 MB/s Jun 12 04:52:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8e6d31-726d-4938-9a73-9b231464ce89]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:53 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD Jun 12 04:52:53 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:54 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD" returned: 0 in 0.672s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Temporary image 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 is fetched for user c0ebf02e8e294aaba280ea45ba423813. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd43d49a-761b-4cc0-9a8a-8e0fab95a14e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:54 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD Jun 12 04:52:54 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:54 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-909518160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1864c4a9-6b41-418b-921b-794823122206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83dc735d3b047a3ac11f7d38203d996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:52:49Z,use_quota=True,user_id='c0ebf02e8e294aaba280ea45ba423813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a5412ab-bbb3-46bc-bcc3-0d294f49286c),volume_type_id=5a5412ab-bbb3-46bc-bcc3-0d294f49286c)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Creating volume 1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:52:54 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:52:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:54 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 1073741824 Jun 12 04:52:54 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:55 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 1073741824" returned: 0 in 0.823s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:55 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:52:55 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "cinder-cc660f7c-1a5e-4009-8f08-ae611a1a7c34-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-cc660f7c-1a5e-4009-8f08-ae611a1a7c34-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "cinder-quobyte-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-quobyte-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e000975e-6590-4d76-8de9-318401e309d7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:55 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 Jun 12 04:52:55 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:56 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 0 in 0.607s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Attempting download of 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 ((None, [{'url': 'file:///opt/stack/data/glance/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'metadata': {}}])) to volume 1864c4a9-6b41-418b-921b-794823122206. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ef6b63-5635-4c5f-a30a-89f0b63e6377]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:56 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7 Jun 12 04:52:56 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:56 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" returned: 0 in 0.725s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:56 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34 Jun 12 04:52:56 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:56 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7" returned: 0 in 0.666s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:57 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7 Jun 12 04:52:57 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:57 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-quobyte-cc660f7c-1a5e-4009-8f08-ae611a1a7c34" released by "delete_volume" :: held 1.353s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Created reservations ['7598cf4b-c17f-41c0-89c9-905b03dbe1de', 'a12c6909-525a-4ab0-973a-3159f7b2fa3f', '8306d0b5-d024-4af7-9655-0b154a5fbe38', '709861e8-7c97-4361-8b77-ebbee47df77e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:57 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:52:57 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:57 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7" returned: 1 in 0.658s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_mttg7ai7' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1b873-c5f5-4bed-88c9-bf5d47d26a85]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:57 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD Jun 12 04:52:57 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:57 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.599s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:52:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Deleted volume successfully. Jun 12 04:52:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b3edf7fa-c36d-4f62-9ac7-6f9415d75830 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-cc660f7c-1a5e-4009-8f08-ae611a1a7c34-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "cinder-6dd1a4e5-5e5e-4405-b25b-006c26c2661a-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-6dd1a4e5-5e5e-4405-b25b-006c26c2661a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "cinder-quobyte-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-quobyte-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef4866-9e2c-4867-a4c4-d027187090f5]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:58 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a Jun 12 04:52:58 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:58 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 was qcow2, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:58 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:52:58 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:58 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" returned: 0 in 0.711s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:58 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a Jun 12 04:52:58 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:52:59 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" returned: 0 in 0.637s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-quobyte-6dd1a4e5-5e5e-4405-b25b-006c26c2661a" released by "delete_volume" :: held 1.388s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Created reservations ['5ae69539-f1bf-41fb-a1b2-88860ebcda1b', '58790de7-97cd-482c-a44d-7a48c00a9788', '7ea7281b-e0f6-4445-9a7d-70e9380ce722', '96f33146-5e46-4807-8a80-1178c0d4de13'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:52:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:52:59 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:52:59 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:00 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 0 in 1.778s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47b2c893-9bf7-4eb9-8bf9-a9d27318d529_bp3ejkkddevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:53:00 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Converted 112.00 MB image at 62.95 MB/s Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:00 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 1G Jun 12 04:53:00 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:00 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.594s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:53:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Deleted volume successfully. Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b5ceedc3-3bf1-40fc-9894-74ad1a21d96b tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-6dd1a4e5-5e5e-4405-b25b-006c26c2661a-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "cinder-ece53a9e-5c8f-4fed-9705-ea3d426941b3-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-ece53a9e-5c8f-4fed-9705-ea3d426941b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "cinder-quobyte-ece53a9e-5c8f-4fed-9705-ea3d426941b3" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-quobyte-ece53a9e-5c8f-4fed-9705-ea3d426941b3" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349fda7-d7ad-4ea6-b2a5-5bbff9df262d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:00 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 Jun 12 04:53:00 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:00 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 1G" returned: 0 in 0.638s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7fc7a3-27b7-4ad2-9940-824442195c1f]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:00 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:53:00 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:01 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3" returned: 0 in 0.710s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:01 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3 Jun 12 04:53:01 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:01 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 0 in 0.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:01 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:53:01 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:01 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece53a9e-5c8f-4fed-9705-ea3d426941b3" returned: 0 in 0.601s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-quobyte-ece53a9e-5c8f-4fed-9705-ea3d426941b3" released by "delete_volume" :: held 1.366s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Created reservations ['7f004e1a-5ba8-47d9-8a40-527985d7786c', '8b1622d7-ec45-452c-bb52-063f724e373a', '6ca1101f-f135-4ae5-a97a-e662b8ffbd88', '1f78f163-e057-48e5-bb34-5e9229366d94'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:02 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:53:02 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:02 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 1 in 0.684s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Downloaded image 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 ((None, [{'url': 'file:///opt/stack/data/glance/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'metadata': {}}])) to volume 1864c4a9-6b41-418b-921b-794823122206 successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Temporary image 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 for user c0ebf02e8e294aaba280ea45ba423813 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Marking volume 1864c4a9-6b41-418b-921b-794823122206 as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Copying metadata from image 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 to 1864c4a9-6b41-418b-921b-794823122206. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Creating volume glance metadata for volume 1864c4a9-6b41-418b-921b-794823122206 backed by image 47b2c893-9bf7-4eb9-8bf9-a9d27318d529 with: {'image_id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'image_name': 'tempest-scenario-img--1345484360', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d81160-e95e-4289-880f-4af99630dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1864c4a9-6b41-418b-921b-794823122206', 'volume_size': 1, 'image_id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1345484360', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b83dc735d3b047a3ac11f7d38203d996', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '47b2c893-9bf7-4eb9-8bf9-a9d27318d529', 'created_at': datetime.datetime(2026, 6, 12, 2, 52, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 52, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47b2c893-9bf7-4eb9-8bf9-a9d27318d529/file', 'properties': {}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502f1d66-2996-4e4e-9370-cd5ced3abad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Volume volume-1864c4a9-6b41-418b-921b-794823122206 (1864c4a9-6b41-418b-921b-794823122206): created successfully Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502f1d66-2996-4e4e-9370-cd5ced3abad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Flow 'volume_create_manager' (a4305372-021d-4b83-938e-74876f897c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:53:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-292d77e9-c014-45bc-90a3-c83e4c3a4d0b tempest-TestInstancesWithCinderVolumes-1519388260 None] Created volume successfully. Jun 12 04:53:02 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.618s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:53:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Deleted volume successfully. Jun 12 04:53:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8dcb539e-a6bd-40c5-b63b-a7d2e2fd55d7 tempest-AttachVolumeNegativeTest-522445774 None] Lock "cinder-ece53a9e-5c8f-4fed-9705-ea3d426941b3-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:10 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d38eb-3c91-40ba-a085-3e5d9343953c]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c249a2a2-a700-42c4-a602-928e44e64d4f tempest-BackendsCapabilitiesAdminTestsJSON-1593608121 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92320) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4842}} Jun 12 04:53:10 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:53:10 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fbbc2eff-5bb2-4966-aff1-6bec02d17b0c tempest-BackendsCapabilitiesAdminTestsJSON-1593608121 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92320) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4842}} Jun 12 04:53:11 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 0 in 0.741s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:11 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:53:11 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:12 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 1 in 0.712s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:53:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.492s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-1864c4a9-6b41-418b-921b-794823122206', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1f45c8b-33ad-4b60-9d07-ab86fd44f8e5', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:53:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-126a5d92-837f-4633-a031-00b84f9d03a8 req-a9019895-ebd0-476b-ad5a-5e55f3f926ef tempest-TestInstancesWithCinderVolumes-1519388260 None] attachment_update completed successfully. Jun 12 04:53:16 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=55,cinder:DELETE=8,cinder:SELECT=50,cinder:INSERT=18 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:53:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0beed2c3-0a49-4018-9ed4-a96a57b9898b tempest-GroupsV314Test-53920822 None] Group tempest-GroupsV314Test-Group-561091256: creating Jun 12 04:53:16 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=66,cinder:INSERT=17,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:53:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0beed2c3-0a49-4018-9ed4-a96a57b9898b tempest-GroupsV314Test-53920822 None] Group tempest-GroupsV314Test-Group-561091256: created successfully Jun 12 04:53:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0beed2c3-0a49-4018-9ed4-a96a57b9898b tempest-GroupsV314Test-53920822 None] Create group completed successfully. Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Flow 'volume_create_manager' (4982314c-3f63-463f-ae34-65943d4027dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1add5686-795e-41f5-ac12-42cce84065df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1add5686-795e-41f5-ac12-42cce84065df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1912520567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f76a3aa-eedd-444f-86cc-561f7e1af82b,host='devstack@QuobyteHD#QuobyteHD',id=2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d0ca6c6cab409b8d9dbf0544c853ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:53:18Z,use_quota=True,user_id='16a1408015214da19d8d4a733e834bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28990f8b-637f-4f52-92a3-19890a1258a4),volume_type_id=28990f8b-637f-4f52-92a3-19890a1258a4)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91590b61-5630-46ec-8e50-7090134707e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91590b61-5630-46ec-8e50-7090134707e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b96c63c-d191-4269-a812-cab705b93f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b96c63c-d191-4269-a812-cab705b93f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d', 'volume_name': 'volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c94177-4344-4ace-9cb6-5e842818faef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c94177-4344-4ace-9cb6-5e842818faef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b272b95-b3f9-4e53-959e-25b4eac21775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:18 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Volume 2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d', 'volume_size': 1} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f76a3aa-eedd-444f-86cc-561f7e1af82b,created_at=2026-06-12T02:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1912520567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f76a3aa-eedd-444f-86cc-561f7e1af82b,host='devstack@QuobyteHD#QuobyteHD',id=2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d0ca6c6cab409b8d9dbf0544c853ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:53:18Z,use_quota=True,user_id='16a1408015214da19d8d4a733e834bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28990f8b-637f-4f52-92a3-19890a1258a4),volume_type_id=28990f8b-637f-4f52-92a3-19890a1258a4)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Creating volume 2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:53:18 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:53:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:18 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d 1073741824 Jun 12 04:53:18 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:19 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d 1073741824" returned: 0 in 0.796s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:19 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:19 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:19 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.668s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:53:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b272b95-b3f9-4e53-959e-25b4eac21775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a58f6e-6da0-4815-9e43-79974d3ffb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:20 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Volume volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d (2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d): created successfully Jun 12 04:53:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a58f6e-6da0-4815-9e43-79974d3ffb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Flow 'volume_create_manager' (4982314c-3f63-463f-ae34-65943d4027dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:53:20 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ba6b341a-a4b6-4ac2-950e-cc2be203c9c9 tempest-GroupsV314Test-53920822 None] Created volume successfully. Jun 12 04:53:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:21 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Cloning volume 2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d to volume 4422afde-adae-4b78-bdee-0113c7988f46 Jun 12 04:53:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Creating offline snapshot b769844e-20cf-41c7-ab2a-169dba37f119 of volume 2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:53:21 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ff63cd-8a7a-471d-88ad-d6b45ab93e64]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:21 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:21 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:22 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.834s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:22 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 1G Jun 12 04:53:22 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:23 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 1G" returned: 0 in 0.905s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:23 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 Jun 12 04:53:23 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:24 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119" returned: 0 in 0.830s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:24 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:53:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:24 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 Jun 12 04:53:24 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:24 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119" returned: 0 in 0.646s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:25 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info Jun 12 04:53:25 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:25 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info" returned: 0 in 0.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:25 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:53:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:25 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info Jun 12 04:53:25 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:26 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.info" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Acquiring lock "cinder-quobyte-4422afde-adae-4b78-bdee-0113c7988f46" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-4422afde-adae-4b78-bdee-0113c7988f46" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] snapshot: b769844e-20cf-41c7-ab2a-169dba37f119, volume: 4422afde-adae-4b78-bdee-0113c7988f46, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[448ee879-29d7-46d8-b86c-ecef967e229a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:26 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 Jun 12 04:53:26 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:27 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119" returned: 0 in 0.802s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[10becfe6-018b-4667-942a-1f28f7eff7ec]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:27 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:27 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:27 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.740s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 04:53:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:27 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 Jun 12 04:53:27 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:31 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:53:31 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:33 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46" returned: 0 in 5.241s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b313670b-bbf8-4ace-ab9f-2e10bf5375a0]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:33 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:33 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:33 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.510s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:53:33 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.836s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:53:33 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Converted 1024.00 MB image at 195.32 MB/s Jun 12 04:53:33 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 is being set with open permissions: ugo+rw: NotImplementedError Jun 12 04:53:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:34 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 Jun 12 04:53:34 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:34 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46" returned: 0 in 0.551s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-4422afde-adae-4b78-bdee-0113c7988f46" released by "_copy_volume_from_snapshot" :: held 8.260s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Acquiring lock "cinder-quobyte-b769844e-20cf-41c7-ab2a-169dba37f119" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-b769844e-20cf-41c7-ab2a-169dba37f119" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Deleting offline snapshot b769844e-20cf-41c7-ab2a-169dba37f119 of volume 2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] snapshot_file for this snap is: volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9784128-6875-4b9b-805c-5883f5479a12]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:34 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 Jun 12 04:53:34 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:35 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:53:35 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119" returned: 0 in 0.764s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:53:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcc5df-4004-4541-bafc-81e8c5369d38]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:35 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:35 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:36 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.710s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:36 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 Jun 12 04:53:36 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:36 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119" returned: 0 in 0.672s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:36 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119 Jun 12 04:53:36 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:37 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d.b769844e-20cf-41c7-ab2a-169dba37f119" returned: 0 in 0.582s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-b769844e-20cf-41c7-ab2a-169dba37f119" released by "_delete_snapshot" :: held 2.828s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.740s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d02c613a-4b21-45a1-bb28-34c18e149da6 tempest-GroupsV314Test-53920822 None] Create group from source-group-6f76a3aa-eedd-444f-86cc-561f7e1af82b completed successfully. Jun 12 04:53:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Acquiring lock "cinder-quobyte-4422afde-adae-4b78-bdee-0113c7988f46" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:53:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-4422afde-adae-4b78-bdee-0113c7988f46" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:53:38 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b903fe5a-2a07-4b9a-8e4a-f1e4b1b51040]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:38 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 Jun 12 04:53:38 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:39 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46" returned: 0 in 0.697s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:39 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46 Jun 12 04:53:39 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:39 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4422afde-adae-4b78-bdee-0113c7988f46" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-4422afde-adae-4b78-bdee-0113c7988f46" released by "delete_volume" :: held 1.320s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Created reservations ['1310c313-e573-432f-b128-e2beb6a3d374'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:53:39 devstack cinder-volume[92320]: WARNING cinder.quota [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2061935005 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2061935005, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:53:39 devstack cinder-volume[92320]: WARNING cinder.quota [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2061935005 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2061935005, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Created reservations ['38400ec1-70c0-43e5-a1d7-3516ed483948', '93729c08-7967-4675-82da-eb6f9f175547', 'a0ce6176-9d4d-4954-9dd4-31b37b14dbba', 'e118fd85-8859-4bb2-857a-473224e83e78'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:39 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:53:39 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:40 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.579s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:40 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:53:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8be7361f-a19b-44af-93ae-41d5bc08346e tempest-GroupsV314Test-53920822 None] Delete group completed successfully. Jun 12 04:53:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Acquiring lock "cinder-quobyte-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:53:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:53:40 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a47ac-acb7-4f5d-b200-7c4cb94ec8ee]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:40 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:40 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:41 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.719s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:41 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d Jun 12 04:53:41 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:42 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" returned: 0 in 0.621s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Lock "cinder-quobyte-2b0ab2c3-c8d3-4acd-a7ef-21ddbafe8a6d" released by "delete_volume" :: held 1.408s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Created reservations ['91086cd3-3e8e-400c-a349-b215b564f127'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Created reservations ['de77e0fd-b26a-485d-8808-f876834dc7a0', 'd98fe63f-8633-4c20-a345-f8163035b55a', '1615f426-09f1-46dd-941f-e783a62210ac', 'e6ad719c-579a-4eeb-8d74-19fc0a1c5c2f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:42 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:53:42 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:42 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.662s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:42 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:53:42 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-bac1e8fd-514b-453f-9570-3c0d1dbd473b tempest-GroupsV314Test-53920822 None] Delete group completed successfully. Jun 12 04:53:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabfc1e-8968-42f4-90e4-bbfc071fa2ee]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:49 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf Jun 12 04:53:49 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:50 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf" returned: 0 in 0.690s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.706s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-935e1b64-ad79-4573-811d-5fe7575cebdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf5aed83-4206-4deb-9bc5-00cc6ad90c56', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:53:50 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-93592918-f0b7-4b18-b494-bb3a06b1e59b req-431aa635-d8eb-4d8f-ad95-e3c34d95d8b3 tempest-TestInstancesWithCinderVolumes-1519388260 None] attachment_update completed successfully. Jun 12 04:53:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:58 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[62168e88-d869-4ad9-88cd-87b0e744dce1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:53:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:58 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c Jun 12 04:53:58 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:53:59 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c" returned: 0 in 0.727s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.744s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-26032432-ad3a-457a-923a-59070ec7da7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '426be7ff-cc67-4bf3-8339-0484d80035e3', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:53:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-4c97b9cf-b573-40b3-a6a5-3b318359d115 req-34dda857-0109-4158-aab4-416eaea259e7 tempest-TestInstancesWithCinderVolumes-1519388260 None] attachment_update completed successfully. Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Flow 'volume_create_manager' (4bf8457c-855f-4594-aa53-f46aa6e238f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d207c4e6-08e9-4e73-9c36-2a996253bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d207c4e6-08e9-4e73-9c36-2a996253bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1928917766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76263388-b900-4a88-8343-c858c6cb6d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff43c1f2c0f4927882397c84650cc17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:53:59Z,use_quota=True,user_id='9b6bde06b0614abf9de3a66e93c02a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e609e3-9817-42fb-8206-d672ca4a50e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e609e3-9817-42fb-8206-d672ca4a50e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc10eef4-b293-4785-ae6a-50335e584648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc10eef4-b293-4785-ae6a-50335e584648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76263388-b900-4a88-8343-c858c6cb6d81', 'volume_name': 'volume-76263388-b900-4a88-8343-c858c6cb6d81', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cb949b-62b1-4b83-9d61-3ad4960df644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cb949b-62b1-4b83-9d61-3ad4960df644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a246f1-d62e-4b97-b553-36c63147feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:53:59 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Volume 76263388-b900-4a88-8343-c858c6cb6d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76263388-b900-4a88-8343-c858c6cb6d81', 'volume_size': 1} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1928917766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76263388-b900-4a88-8343-c858c6cb6d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff43c1f2c0f4927882397c84650cc17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:53:59Z,use_quota=True,user_id='9b6bde06b0614abf9de3a66e93c02a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Creating volume 76263388-b900-4a88-8343-c858c6cb6d81 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:53:59 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:53:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:53:59 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 1073741824 Jun 12 04:53:59 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:00 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 1073741824" returned: 0 in 0.770s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:00 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 Jun 12 04:54:00 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:00 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a246f1-d62e-4b97-b553-36c63147feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76263388-b900-4a88-8343-c858c6cb6d81', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd33293b-3009-49f0-a1e9-113e1a1e1df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:00 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Volume volume-76263388-b900-4a88-8343-c858c6cb6d81 (76263388-b900-4a88-8343-c858c6cb6d81): created successfully Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd33293b-3009-49f0-a1e9-113e1a1e1df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Flow 'volume_create_manager' (4bf8457c-855f-4594-aa53-f46aa6e238f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-739a6547-ac64-43da-a9f9-056831911bf8 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Created volume successfully. Jun 12 04:54:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Acquiring lock "cinder-76263388-b900-4a88-8343-c858c6cb6d81-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "cinder-76263388-b900-4a88-8343-c858c6cb6d81-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Acquiring lock "cinder-quobyte-76263388-b900-4a88-8343-c858c6cb6d81" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "cinder-quobyte-76263388-b900-4a88-8343-c858c6cb6d81" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:02 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02529f-8fb7-4a8d-8260-0cd1554bbe45]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:02 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 Jun 12 04:54:02 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:03 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81" returned: 0 in 0.690s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:03 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81 Jun 12 04:54:03 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:03 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-76263388-b900-4a88-8343-c858c6cb6d81" returned: 0 in 0.576s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "cinder-quobyte-76263388-b900-4a88-8343-c858c6cb6d81" released by "delete_volume" :: held 1.307s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Created reservations ['d6711857-023f-4877-ab55-87d672629b51', '04dd38e8-9907-4c4b-9df9-840a9bfe13b1', '8b0b7c77-d2aa-4e49-b2f4-d62394f2481e', 'c0aa1f56-c271-4021-8242-645e466178b1'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:03 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:03 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:04 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.598s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:04 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:04 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Deleted volume successfully. Jun 12 04:54:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a5256bb7-7efd-4134-b516-b04857e018e3 tempest-VolumeQuotasNegativeTestJSON-1805760684 None] Lock "cinder-76263388-b900-4a88-8343-c858c6cb6d81-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-ef48020e-70ba-4c58-bab5-7cebd0f11b23 req-df03bdf8-b66b-4cbb-a8c0-8f01b9569769 tempest-TestInstancesWithCinderVolumes-1519388260 None] Terminate volume connection completed successfully. Jun 12 04:54:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-ef48020e-70ba-4c58-bab5-7cebd0f11b23 req-df03bdf8-b66b-4cbb-a8c0-8f01b9569769 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deleting attachment cf5aed83-4206-4deb-9bc5-00cc6ad90c56. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Flow 'volume_create_manager' (d1e89832-0b8b-4680-baf0-cdaee621809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db02ebbf-7e14-4c91-8c88-d998ce314866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db02ebbf-7e14-4c91-8c88-d998ce314866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-277218010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da444372-76dd-4687-b717-bd9ca1904c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30806c42760c4a629324d25d5dbb12ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:09Z,use_quota=True,user_id='353d7ff0705a411faa3243c0e7c9d8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2164ca03-1c46-41ae-83d9-381d7245a726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2164ca03-1c46-41ae-83d9-381d7245a726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d06d37a-6b2a-4c4a-abbf-8bc372b6e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d06d37a-6b2a-4c4a-abbf-8bc372b6e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da444372-76dd-4687-b717-bd9ca1904c17', 'volume_name': 'volume-da444372-76dd-4687-b717-bd9ca1904c17', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1df18f0-1a08-4850-a23c-8688bd8c335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1df18f0-1a08-4850-a23c-8688bd8c335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e2fe4d-ec76-4961-9a76-7b154b980be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Volume da444372-76dd-4687-b717-bd9ca1904c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da444372-76dd-4687-b717-bd9ca1904c17', 'volume_size': 1} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-277218010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da444372-76dd-4687-b717-bd9ca1904c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30806c42760c4a629324d25d5dbb12ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:09Z,use_quota=True,user_id='353d7ff0705a411faa3243c0e7c9d8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Creating volume da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:54:09 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:54:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:09 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 1073741824 Jun 12 04:54:09 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "cinder-935e1b64-ad79-4573-811d-5fe7575cebdf-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-935e1b64-ad79-4573-811d-5fe7575cebdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "cinder-quobyte-935e1b64-ad79-4573-811d-5fe7575cebdf" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-quobyte-935e1b64-ad79-4573-811d-5fe7575cebdf" acquired by "delete_volume" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ca6ccd-0e59-48a0-a7c3-360dc0f2618b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:10 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 1073741824" returned: 0 in 0.794s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:10 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 Jun 12 04:54:10 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:10 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf Jun 12 04:54:10 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:10 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17" returned: 0 in 0.648s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e2fe4d-ec76-4961-9a76-7b154b980be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da444372-76dd-4687-b717-bd9ca1904c17', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37e3dcc-8192-4bd9-996f-ac234c006501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:11 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf" returned: 0 in 0.762s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:11 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Volume volume-da444372-76dd-4687-b717-bd9ca1904c17 (da444372-76dd-4687-b717-bd9ca1904c17): created successfully Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37e3dcc-8192-4bd9-996f-ac234c006501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:11 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf Jun 12 04:54:11 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Flow 'volume_create_manager' (d1e89832-0b8b-4680-baf0-cdaee621809c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-dad6379f-5e3e-4d7b-8e66-8374b8a14f69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Created volume successfully. Jun 12 04:54:11 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-935e1b64-ad79-4573-811d-5fe7575cebdf" returned: 0 in 0.627s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-quobyte-935e1b64-ad79-4573-811d-5fe7575cebdf" released by "delete_volume" :: held 1.430s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:11 devstack cinder-volume[92320]: WARNING cinder.quota [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1565098174-1667184931 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1565098174-1667184931, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:54:11 devstack cinder-volume[92320]: WARNING cinder.quota [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1565098174-1667184931 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1565098174-1667184931, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Created reservations ['0b999522-f82e-427f-b5bf-28eabd791a16', 'bc00cdda-e09d-4117-a3e9-aa8036d89d66', 'ef793b65-478d-4f07-be40-86b1250f4ddc', '68a104b3-70ab-4d2b-8482-a3baa0468393'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Creating offline snapshot a58d4b85-cabc-4c71-902c-bd62847d0ef1 of volume da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:54:11 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:11 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f22301-2ff7-4c1d-8b54-62e8bb9c5813]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:12 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 Jun 12 04:54:12 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:12 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.659s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:12 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deleted volume successfully. Jun 12 04:54:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d00c5374-0027-4b7a-a12a-e81462083fb6 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-935e1b64-ad79-4573-811d-5fe7575cebdf-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:12 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17" returned: 0 in 0.776s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:12 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 1G Jun 12 04:54:12 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:13 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 1G" returned: 0 in 0.789s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da444372-76dd-4687-b717-bd9ca1904c17 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:13 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da444372-76dd-4687-b717-bd9ca1904c17 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 Jun 12 04:54:13 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:14 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da444372-76dd-4687-b717-bd9ca1904c17 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1" returned: 0 in 0.615s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:14 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 is being set with open permissions: ugo+rw Jun 12 04:54:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:14 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 Jun 12 04:54:14 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:14 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:14 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info Jun 12 04:54:14 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-8a0eac53-60d7-4e5f-ac8e-538af6d4e7ab req-4e755613-0018-49b9-98ac-7d3097caab7a tempest-TestInstancesWithCinderVolumes-1519388260 None] Terminate volume connection completed successfully. Jun 12 04:54:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-8a0eac53-60d7-4e5f-ac8e-538af6d4e7ab req-4e755613-0018-49b9-98ac-7d3097caab7a tempest-TestInstancesWithCinderVolumes-1519388260 None] Deleting attachment 426be7ff-cc67-4bf3-8339-0484d80035e3. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:54:15 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info" returned: 0 in 0.576s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:15 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info is being set with open permissions: ugo+rw Jun 12 04:54:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:15 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info Jun 12 04:54:15 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:15 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.info" returned: 0 in 0.599s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.090s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6052d79d-58f8-4153-801a-c2aee326bf94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Create snapshot completed successfully Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "cinder-26032432-ad3a-457a-923a-59070ec7da7c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-26032432-ad3a-457a-923a-59070ec7da7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=68,cinder:SELECT=57,cinder:INSERT=12,cinder:DELETE=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "cinder-quobyte-26032432-ad3a-457a-923a-59070ec7da7c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-quobyte-26032432-ad3a-457a-923a-59070ec7da7c" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f589e53-b8bc-43b6-815f-8970083d839a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:16 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c Jun 12 04:54:16 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "cinder-a58d4b85-cabc-4c71-902c-bd62847d0ef1-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-a58d4b85-cabc-4c71-902c-bd62847d0ef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "cinder-quobyte-da444372-76dd-4687-b717-bd9ca1904c17" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-quobyte-da444372-76dd-4687-b717-bd9ca1904c17" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "cinder-quobyte-a58d4b85-cabc-4c71-902c-bd62847d0ef1" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-quobyte-a58d4b85-cabc-4c71-902c-bd62847d0ef1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Deleting offline snapshot a58d4b85-cabc-4c71-902c-bd62847d0ef1 of volume da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] snapshot_file for this snap is: volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[768573c4-4178-4998-a791-b8641c4188e9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:17 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c" returned: 0 in 0.870s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:17 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c Jun 12 04:54:17 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:17 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 Jun 12 04:54:17 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:18 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-26032432-ad3a-457a-923a-59070ec7da7c" returned: 0 in 0.721s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-quobyte-26032432-ad3a-457a-923a-59070ec7da7c" released by "delete_volume" :: held 1.636s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:18 devstack cinder-volume[92320]: WARNING cinder.quota [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338384266-701061246 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338384266-701061246, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:54:18 devstack cinder-volume[92320]: WARNING cinder.quota [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338384266-701061246 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-338384266-701061246, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Created reservations ['7a1ed577-277f-49e8-9278-3a23f8ef0a15', '83805db7-7e71-4227-8987-56b7a9130e00', '8698778c-e0a2-4d38-bcec-489f96de1f54', 'e67d3e63-178f-4c5d-b0e5-d9476738c438'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:18 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1" returned: 0 in 0.904s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da444372-76dd-4687-b717-bd9ca1904c17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c56ef8e-af04-4be0-8ab0-bf9f657f16b8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:18 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:18 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:18 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 Jun 12 04:54:18 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:19 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.810s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:19 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:19 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Deleted volume successfully. Jun 12 04:54:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17" returned: 0 in 0.921s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-10cb632a-e945-4dc7-a175-4020cc3379c3 tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-26032432-ad3a-457a-923a-59070ec7da7c-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:19 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 Jun 12 04:54:19 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:20 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1" returned: 0 in 0.701s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:20 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1 Jun 12 04:54:20 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:21 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17.a58d4b85-cabc-4c71-902c-bd62847d0ef1" returned: 0 in 0.825s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-quobyte-a58d4b85-cabc-4c71-902c-bd62847d0ef1" released by "_delete_snapshot" :: held 3.488s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-quobyte-da444372-76dd-4687-b717-bd9ca1904c17" released by "delete_snapshot" :: held 3.511s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Created reservations ['e079307d-1ae6-4b09-8a58-606033dc029d', 'f2d139a4-f6cc-465a-819e-20cadaad2ccd', '7b48cb86-7fa0-41e9-aea7-a4b7ea469391', 'fc59f897-d981-47bc-a798-f30d1be6fbd2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Delete snapshot completed successfully. Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f3d2a0ca-a272-48ac-bfbb-f0eeb415fbe3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-a58d4b85-cabc-4c71-902c-bd62847d0ef1-delete_snapshot" released by "delete_snapshot" :: held 3.660s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "cinder-da444372-76dd-4687-b717-bd9ca1904c17-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-da444372-76dd-4687-b717-bd9ca1904c17-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "cinder-quobyte-da444372-76dd-4687-b717-bd9ca1904c17" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-quobyte-da444372-76dd-4687-b717-bd9ca1904c17" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf2cfda-c9d6-4962-829e-f9328498f0d5]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:22 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 Jun 12 04:54:22 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:22 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17" returned: 0 in 0.733s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:22 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17 Jun 12 04:54:22 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:23 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da444372-76dd-4687-b717-bd9ca1904c17" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-quobyte-da444372-76dd-4687-b717-bd9ca1904c17" released by "delete_volume" :: held 1.393s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Created reservations ['9e658fbe-2f63-4852-b3e5-a1dc26cc8425', 'ad68e647-bb23-4968-9a95-058d0f2d0bf8', '2e3a11ee-de73-4012-9ecd-179147688031', '5a05a2d1-6162-4c85-9caf-aa6fdbdb2a8d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:23 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:23 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-7e6cb466-9fdc-46a9-83d7-1751a05bd1af req-e2ee794b-88f5-45fe-856b-2f705d0f017c tempest-TestInstancesWithCinderVolumes-1519388260 None] Terminate volume connection completed successfully. Jun 12 04:54:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-7e6cb466-9fdc-46a9-83d7-1751a05bd1af req-e2ee794b-88f5-45fe-856b-2f705d0f017c tempest-TestInstancesWithCinderVolumes-1519388260 None] Deleting attachment c1f45c8b-33ad-4b60-9d07-ab86fd44f8e5. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:54:24 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.636s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:24 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Deleted volume successfully. Jun 12 04:54:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b758707a-0feb-40fa-8fe4-2849b70bb4aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1004277027 None] Lock "cinder-da444372-76dd-4687-b717-bd9ca1904c17-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "cinder-1864c4a9-6b41-418b-921b-794823122206-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-1864c4a9-6b41-418b-921b-794823122206-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "cinder-quobyte-1864c4a9-6b41-418b-921b-794823122206" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-quobyte-1864c4a9-6b41-418b-921b-794823122206" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3167f5b-3222-4f8e-9b10-033e6f370952]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:27 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:54:27 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:27 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:27 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:54:27 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:28 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 1 in 0.731s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:54:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:28 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206 Jun 12 04:54:28 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:29 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1864c4a9-6b41-418b-921b-794823122206" returned: 0 in 0.629s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-quobyte-1864c4a9-6b41-418b-921b-794823122206" released by "delete_volume" :: held 2.169s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:29 devstack cinder-volume[92320]: WARNING cinder.quota [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-145453536-1814351122 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-145453536-1814351122, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:54:29 devstack cinder-volume[92320]: WARNING cinder.quota [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-145453536-1814351122 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-145453536-1814351122, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Created reservations ['3e2eb969-03bd-443a-bbdd-f9bea7f9acbd', 'fe5ea61f-1b82-4ff6-8b9e-bc637abd8b22', '707fefa8-327f-4336-95ed-b5e871a58e24', '751dd20a-a54a-4159-b790-7b20f7750259'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Flow 'volume_create_manager' (26cc7ff9-a205-4374-bce0-9a0d1c2d7d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d88d0d-dbab-4b90-a220-4ad6da9a3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d88d0d-dbab-4b90-a220-4ad6da9a3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1886380187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51c81df-ed54-4ee6-a96e-e457e2bc124e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a316b51eaf845e888fddb0952cebff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:29Z,use_quota=True,user_id='5653e65a835c4005bbc55a90fa0c4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a855799b-3963-409b-ae3f-3dae9e1e9348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a855799b-3963-409b-ae3f-3dae9e1e9348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2b8d5f-1996-4878-a082-cfd4e4aba7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2b8d5f-1996-4878-a082-cfd4e4aba7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51c81df-ed54-4ee6-a96e-e457e2bc124e', 'volume_name': 'volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b76c4b5-726b-4bc8-94aa-88e7eee4ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b76c4b5-726b-4bc8-94aa-88e7eee4ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b8614a-cac5-4427-95f4-65b8bf68e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:29 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Volume c51c81df-ed54-4ee6-a96e-e457e2bc124e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e', 'volume_size': 1} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1886380187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51c81df-ed54-4ee6-a96e-e457e2bc124e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a316b51eaf845e888fddb0952cebff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:29Z,use_quota=True,user_id='5653e65a835c4005bbc55a90fa0c4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Creating volume c51c81df-ed54-4ee6-a96e-e457e2bc124e {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:54:29 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:29 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e 1073741824 Jun 12 04:54:29 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:29 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:29 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:29 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.642s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Deleted volume successfully. Jun 12 04:54:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d875bb69-d9bf-4093-b284-94793252b96d tempest-TestInstancesWithCinderVolumes-1519388260 None] Lock "cinder-1864c4a9-6b41-418b-921b-794823122206-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:30 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e 1073741824" returned: 0 in 0.779s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:30 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e Jun 12 04:54:30 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:30 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e" returned: 0 in 0.646s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b8614a-cac5-4427-95f4-65b8bf68e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e143f9a9-eb01-438d-8fed-2f40451d7890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:30 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Volume volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e (c51c81df-ed54-4ee6-a96e-e457e2bc124e): created successfully Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e143f9a9-eb01-438d-8fed-2f40451d7890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Flow 'volume_create_manager' (26cc7ff9-a205-4374-bce0-9a0d1c2d7d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-32dc84ce-de65-4f0b-afcb-d99b8610ec7d tempest-VolumesListAdminTestJSON-228576649 None] Created volume successfully. Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:31 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:31 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Flow 'volume_create_manager' (4f78666d-f314-43a5-859b-6a26f7814c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5db533b-554b-45a4-8c2e-279fba8338bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5db533b-554b-45a4-8c2e-279fba8338bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1442807512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154a7010-ba36-492c-aec3-23c2a41bb2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a316b51eaf845e888fddb0952cebff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:32Z,use_quota=True,user_id='5653e65a835c4005bbc55a90fa0c4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba66e80-2008-4b83-9455-387fcabdf976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba66e80-2008-4b83-9455-387fcabdf976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c386234a-a77f-4456-ad33-9a5d96ef21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c386234a-a77f-4456-ad33-9a5d96ef21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154a7010-ba36-492c-aec3-23c2a41bb2d4', 'volume_name': 'volume-154a7010-ba36-492c-aec3-23c2a41bb2d4', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ef54a8-fde4-4783-b470-8460af9453b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ef54a8-fde4-4783-b470-8460af9453b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9b2f6f-35b9-43d2-bf9c-d701a1524e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:31 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Volume 154a7010-ba36-492c-aec3-23c2a41bb2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154a7010-ba36-492c-aec3-23c2a41bb2d4', 'volume_size': 1} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1442807512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154a7010-ba36-492c-aec3-23c2a41bb2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a316b51eaf845e888fddb0952cebff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:32Z,use_quota=True,user_id='5653e65a835c4005bbc55a90fa0c4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Creating volume 154a7010-ba36-492c-aec3-23c2a41bb2d4 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:54:31 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:54:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:31 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 1073741824 Jun 12 04:54:31 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:32 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.706s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:54:32 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 1073741824" returned: 0 in 1.008s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:32 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 Jun 12 04:54:32 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:33 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4" returned: 0 in 0.684s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9b2f6f-35b9-43d2-bf9c-d701a1524e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154a7010-ba36-492c-aec3-23c2a41bb2d4', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a386a045-3aec-4719-953d-9bd42d3430b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:33 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Volume volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 (154a7010-ba36-492c-aec3-23c2a41bb2d4): created successfully Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a386a045-3aec-4719-953d-9bd42d3430b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Flow 'volume_create_manager' (4f78666d-f314-43a5-859b-6a26f7814c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:33 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-35ef807a-b60d-43a4-b6ee-9918dc3b61fb tempest-VolumesListAdminTestJSON-228576649 None] Created volume successfully. Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Flow 'volume_create_manager' (b0fd7644-ac8e-422c-9052-b4ab65db7537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcd311b-4048-4173-8684-0f340f424ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcd311b-4048-4173-8684-0f340f424ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-448771337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4286be-4765-4361-aa7a-c82b8568fd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a316b51eaf845e888fddb0952cebff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:34Z,use_quota=True,user_id='5653e65a835c4005bbc55a90fa0c4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4407c033-da14-44f1-8076-1ef0ea1391b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4407c033-da14-44f1-8076-1ef0ea1391b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22dd5e9-2220-4c49-9445-cfee71e36290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22dd5e9-2220-4c49-9445-cfee71e36290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4286be-4765-4361-aa7a-c82b8568fd15', 'volume_name': 'volume-1c4286be-4765-4361-aa7a-c82b8568fd15', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a94882-3001-42d1-ad62-8b622cebb0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a94882-3001-42d1-ad62-8b622cebb0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0239d1bf-1047-4934-a390-e81cf21bae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Volume 1c4286be-4765-4361-aa7a-c82b8568fd15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4286be-4765-4361-aa7a-c82b8568fd15', 'volume_size': 1} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-448771337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4286be-4765-4361-aa7a-c82b8568fd15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a316b51eaf845e888fddb0952cebff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:34Z,use_quota=True,user_id='5653e65a835c4005bbc55a90fa0c4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Creating volume 1c4286be-4765-4361-aa7a-c82b8568fd15 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:54:34 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:54:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:34 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 1073741824 Jun 12 04:54:34 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:35 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 1073741824" returned: 0 in 0.831s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:35 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=78,cinder:SELECT=85,cinder:INSERT=16,cinder:DELETE=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:54:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:35 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 Jun 12 04:54:35 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:36 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15" returned: 0 in 0.639s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0239d1bf-1047-4934-a390-e81cf21bae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4286be-4765-4361-aa7a-c82b8568fd15', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0745dd53-80f1-4dc2-8489-bcde260177e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Volume volume-1c4286be-4765-4361-aa7a-c82b8568fd15 (1c4286be-4765-4361-aa7a-c82b8568fd15): created successfully Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0745dd53-80f1-4dc2-8489-bcde260177e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Flow 'volume_create_manager' (b0fd7644-ac8e-422c-9052-b4ab65db7537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-97166790-915d-4c1f-b285-08d706988001 tempest-VolumesListAdminTestJSON-228576649 None] Created volume successfully. Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Flow 'volume_create_manager' (8e640c8c-ae1f-4197-8cd3-926e0076eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9e7ca5-b476-4a6a-9a1a-e6d5b52fb717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9e7ca5-b476-4a6a-9a1a-e6d5b52fb717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00335761-7271-40db-bbf8-9866b252022b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342491e488484e41886e004b335f1287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:37Z,use_quota=True,user_id='c14bad41674d4244a013cc280ada9075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a163a2a5-dd8c-4469-9361-9ce61015aa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a163a2a5-dd8c-4469-9361-9ce61015aa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ba62c0-904d-4073-bd70-736906746125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ba62c0-904d-4073-bd70-736906746125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00335761-7271-40db-bbf8-9866b252022b', 'volume_name': 'volume-00335761-7271-40db-bbf8-9866b252022b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84552614-1467-4df4-ad5a-59864a39721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84552614-1467-4df4-ad5a-59864a39721b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ff1411-918b-4d13-afce-6c6bbcb73182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:37 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Volume 00335761-7271-40db-bbf8-9866b252022b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00335761-7271-40db-bbf8-9866b252022b', 'volume_size': 1} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00335761-7271-40db-bbf8-9866b252022b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342491e488484e41886e004b335f1287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:37Z,use_quota=True,user_id='c14bad41674d4244a013cc280ada9075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Creating volume 00335761-7271-40db-bbf8-9866b252022b {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:54:37 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:54:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:37 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b 1073741824 Jun 12 04:54:37 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:38 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b 1073741824" returned: 0 in 0.923s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:38 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b Jun 12 04:54:38 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:38 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b" returned: 0 in 0.626s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ff1411-918b-4d13-afce-6c6bbcb73182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00335761-7271-40db-bbf8-9866b252022b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c336b4-9ddb-4240-a2ab-95d577c9a141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Volume volume-00335761-7271-40db-bbf8-9866b252022b (00335761-7271-40db-bbf8-9866b252022b): created successfully Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c336b4-9ddb-4240-a2ab-95d577c9a141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Flow 'volume_create_manager' (8e640c8c-ae1f-4197-8cd3-926e0076eba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d29fb816-e2dc-415b-836c-86f920b90feb tempest-VolumesListAdminTestJSON-208101701 None] Created volume successfully. Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Acquiring lock "cinder-00335761-7271-40db-bbf8-9866b252022b-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Lock "cinder-00335761-7271-40db-bbf8-9866b252022b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Acquiring lock "cinder-quobyte-00335761-7271-40db-bbf8-9866b252022b" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Lock "cinder-quobyte-00335761-7271-40db-bbf8-9866b252022b" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ba07d-b353-4171-9c1b-21595027fe9b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "cinder-1c4286be-4765-4361-aa7a-c82b8568fd15-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-1c4286be-4765-4361-aa7a-c82b8568fd15-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "cinder-quobyte-1c4286be-4765-4361-aa7a-c82b8568fd15" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-quobyte-1c4286be-4765-4361-aa7a-c82b8568fd15" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:39 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b Jun 12 04:54:39 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ac1862-b38e-4235-9945-dc33f9241eee]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:39 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 Jun 12 04:54:39 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:40 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b" returned: 0 in 0.781s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:40 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b Jun 12 04:54:40 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:40 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15" returned: 0 in 0.776s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:40 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15 Jun 12 04:54:40 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:40 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-00335761-7271-40db-bbf8-9866b252022b" returned: 0 in 0.634s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Lock "cinder-quobyte-00335761-7271-40db-bbf8-9866b252022b" released by "delete_volume" :: held 1.470s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:40 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Created reservations ['6445a1bc-042e-4adc-8ed4-2228c720a58c', '0e2e5492-4a63-4796-9cc9-44538a620c40', 'b9dddc33-6576-4078-bf22-2275ef822d14', '2f5f8f09-1e75-46c9-80b4-01ee7509bf96'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:41 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1c4286be-4765-4361-aa7a-c82b8568fd15" returned: 0 in 0.647s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:41 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-quobyte-1c4286be-4765-4361-aa7a-c82b8568fd15" released by "delete_volume" :: held 1.480s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:41 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Created reservations ['7fc4a406-9e79-48b8-a19b-e9e719c9f0be', '25385fca-d7ba-49cf-b9f4-de1c5c35fde8', '63111be4-15b3-46fa-962b-f632d34bc663', '0c530963-83b9-40c6-acc3-1c6d9347eae8'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:41 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:41 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:41 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.638s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:41 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Deleted volume successfully. Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a1a77f9-0d2a-4b90-9337-96297de30890 tempest-VolumesListAdminTestJSON-208101701 None] Lock "cinder-00335761-7271-40db-bbf8-9866b252022b-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:41 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.670s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:41 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Deleted volume successfully. Jun 12 04:54:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-40a4fde7-618c-4513-b95b-628753e63351 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-1c4286be-4765-4361-aa7a-c82b8568fd15-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "cinder-154a7010-ba36-492c-aec3-23c2a41bb2d4-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-154a7010-ba36-492c-aec3-23c2a41bb2d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "cinder-quobyte-154a7010-ba36-492c-aec3-23c2a41bb2d4" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-quobyte-154a7010-ba36-492c-aec3-23c2a41bb2d4" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[727cbe70-9da3-4601-af07-92145888ced9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:42 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 Jun 12 04:54:42 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:42 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4" returned: 0 in 0.736s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:42 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4 Jun 12 04:54:42 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:43 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-154a7010-ba36-492c-aec3-23c2a41bb2d4" returned: 0 in 0.603s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-quobyte-154a7010-ba36-492c-aec3-23c2a41bb2d4" released by "delete_volume" :: held 1.384s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Created reservations ['063ac4b6-b8f4-423c-953d-de655f334cf0', 'fba1a38b-a46f-462f-883f-5704ade55eb6', '9949e854-b888-4df4-986a-3ec4ebc9634e', 'f55d4814-2b63-4d26-8115-e98f9e482446'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:43 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:43 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:44 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:44 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Deleted volume successfully. Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-565cf465-d41f-4fd7-9b4f-a0f36a338ae4 tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-154a7010-ba36-492c-aec3-23c2a41bb2d4-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "cinder-c51c81df-ed54-4ee6-a96e-e457e2bc124e-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-c51c81df-ed54-4ee6-a96e-e457e2bc124e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "cinder-quobyte-c51c81df-ed54-4ee6-a96e-e457e2bc124e" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-quobyte-c51c81df-ed54-4ee6-a96e-e457e2bc124e" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[95160bfd-0018-4085-8e02-59762644555c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:44 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e Jun 12 04:54:44 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:45 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e" returned: 0 in 0.705s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:45 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e Jun 12 04:54:45 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:45 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c51c81df-ed54-4ee6-a96e-e457e2bc124e" returned: 0 in 0.715s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-quobyte-c51c81df-ed54-4ee6-a96e-e457e2bc124e" released by "delete_volume" :: held 1.465s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:45 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Created reservations ['c0da6e1c-ff53-47bd-b29b-417e46be5377', 'a57ad2e0-e9f4-4bb3-8be4-b6add87630ba', 'ac45553c-8ffb-46b2-b80f-1a25f1018009', '3639da5d-3bb2-46bb-af68-e41af007539c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:46 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:46 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:46 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.685s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Deleted volume successfully. Jun 12 04:54:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-328e313a-5e23-437d-bcb8-e5ed21fa477e tempest-VolumesListAdminTestJSON-228576649 None] Lock "cinder-c51c81df-ed54-4ee6-a96e-e457e2bc124e-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Flow 'volume_create_manager' (33cfc0a8-1f07-455c-9bd7-55e97c06ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b69b8d3-27d2-4ac6-bc70-fcdf2b071b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b69b8d3-27d2-4ac6-bc70-fcdf2b071b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1039397354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555194c9-b74f-45f7-9bd2-0eae77920137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e423e7155d1845cd94d0c5afe0770319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:54Z,use_quota=True,user_id='798663ce97b84b00b27bf699caea0023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a4e1a0-d274-4e01-b6e6-e3e610cd2999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a4e1a0-d274-4e01-b6e6-e3e610cd2999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339e5647-d142-4fba-bab3-5b8eded60ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339e5647-d142-4fba-bab3-5b8eded60ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555194c9-b74f-45f7-9bd2-0eae77920137', 'volume_name': 'volume-555194c9-b74f-45f7-9bd2-0eae77920137', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98d211c-cc0f-445b-bfca-7bb16628f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98d211c-cc0f-445b-bfca-7bb16628f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b461ce7d-bcaf-4648-9bed-cf3d0e7b85ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:54 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Volume 555194c9-b74f-45f7-9bd2-0eae77920137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555194c9-b74f-45f7-9bd2-0eae77920137', 'volume_size': 1} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1039397354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555194c9-b74f-45f7-9bd2-0eae77920137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e423e7155d1845cd94d0c5afe0770319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:54:54Z,use_quota=True,user_id='798663ce97b84b00b27bf699caea0023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Creating volume 555194c9-b74f-45f7-9bd2-0eae77920137 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:54:54 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:54:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:54 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 1073741824 Jun 12 04:54:54 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:55 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 1073741824" returned: 0 in 0.891s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:55 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 Jun 12 04:54:55 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:56 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137" returned: 0 in 0.688s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b461ce7d-bcaf-4648-9bed-cf3d0e7b85ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555194c9-b74f-45f7-9bd2-0eae77920137', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b726ee90-5d05-4955-8bd5-2f8f6e7eb719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:54:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Volume volume-555194c9-b74f-45f7-9bd2-0eae77920137 (555194c9-b74f-45f7-9bd2-0eae77920137): created successfully Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b726ee90-5d05-4955-8bd5-2f8f6e7eb719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Flow 'volume_create_manager' (33cfc0a8-1f07-455c-9bd7-55e97c06ff52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:54:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4a3daa47-1c34-4374-b968-30d7538aaa37 tempest-AbsoluteLimitsTests-548907646 None] Created volume successfully. Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Acquiring lock "cinder-555194c9-b74f-45f7-9bd2-0eae77920137-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Lock "cinder-555194c9-b74f-45f7-9bd2-0eae77920137-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Acquiring lock "cinder-quobyte-555194c9-b74f-45f7-9bd2-0eae77920137" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Lock "cinder-quobyte-555194c9-b74f-45f7-9bd2-0eae77920137" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83fefae-f5f5-4258-8ec5-4696a5c661a7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:54:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:57 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 Jun 12 04:54:57 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:57 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137" returned: 0 in 0.838s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:57 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137 Jun 12 04:54:57 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:58 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-555194c9-b74f-45f7-9bd2-0eae77920137" returned: 0 in 0.671s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Lock "cinder-quobyte-555194c9-b74f-45f7-9bd2-0eae77920137" released by "delete_volume" :: held 1.560s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Created reservations ['f8d50318-a96f-430f-b0c0-baa9a5e5da08', '6e802a65-18d2-4676-8790-95c08e6b2df2', '005852e3-da13-42ad-a3a1-c1549f2c9298', '3684fd02-21ac-42ee-83d0-861709a4579d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:54:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:54:58 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:54:58 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:54:59 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jun 12 04:54:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:54:59 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:54:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Deleted volume successfully. Jun 12 04:54:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-cbc0ae68-731b-40ed-9687-0a40d305e2fa tempest-AbsoluteLimitsTests-548907646 None] Lock "cinder-555194c9-b74f-45f7-9bd2-0eae77920137-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:55:08 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=58,cinder:INSERT=25,cinder:UPDATE=81,cinder:DELETE=9 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:55:09 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=50,cinder:SELECT=27,cinder:INSERT=11,cinder:DELETE=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Flow 'volume_create_manager' (9d1c4a27-7eaa-4595-a861-39074fe05d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faae5768-3b3f-4a2e-a99a-196d512f8721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faae5768-3b3f-4a2e-a99a-196d512f8721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-245195970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe18354-9e2b-426c-9f7a-93135e0dfaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded936b4043a421ab26dba65fe38cb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:55:12Z,use_quota=True,user_id='5fe43c681aea4a9892dfd15cc6b1f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c1d0e5-0925-497f-9500-def6538eaec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c1d0e5-0925-497f-9500-def6538eaec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1281c35e-a640-4244-b6d3-771a151dc5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1281c35e-a640-4244-b6d3-771a151dc5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe18354-9e2b-426c-9f7a-93135e0dfaf9', 'volume_name': 'volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea475aa-6a6b-4e59-b987-b82511aa7521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea475aa-6a6b-4e59-b987-b82511aa7521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2437178-333b-4a85-9209-c8fc3ed02042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:11 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Volume 5fe18354-9e2b-426c-9f7a-93135e0dfaf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9', 'volume_size': 1} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-245195970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe18354-9e2b-426c-9f7a-93135e0dfaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded936b4043a421ab26dba65fe38cb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:55:12Z,use_quota=True,user_id='5fe43c681aea4a9892dfd15cc6b1f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Creating volume 5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:55:11 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:55:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:55:11 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 1073741824 Jun 12 04:55:11 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:55:12 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jun 12 04:55:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 1073741824" returned: 0 in 0.852s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:55:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:55:12 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:55:12 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:55:13 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2437178-333b-4a85-9209-c8fc3ed02042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ba90d0-2837-4ef8-849e-3034109a9491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:13 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Volume volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 (5fe18354-9e2b-426c-9f7a-93135e0dfaf9): created successfully Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ba90d0-2837-4ef8-849e-3034109a9491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Flow 'volume_create_manager' (9d1c4a27-7eaa-4595-a861-39074fe05d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:55:13 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8dcf0842-f698-4c56-af60-629d495544be tempest-VolumesActionsTest-518565329 None] Created volume successfully. Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Flow 'volume_create_manager' (1276f9d8-c5b7-467d-8fa5-0955ce2098a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471bcf25-24a7-473e-aca5-3d82820852a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471bcf25-24a7-473e-aca5-3d82820852a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-440824896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa329108-3340-47ac-9af1-739ebe548c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5444bf6836544a4a66c6e2f37282135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:55:21Z,use_quota=True,user_id='abe8163ba6504bb3a28a540706e246fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e9d6da-db6f-4c8e-a06b-5685f1ef42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e9d6da-db6f-4c8e-a06b-5685f1ef42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22f4c0f-5504-4e69-a7fd-6803cd404837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22f4c0f-5504-4e69-a7fd-6803cd404837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa329108-3340-47ac-9af1-739ebe548c27', 'volume_name': 'volume-fa329108-3340-47ac-9af1-739ebe548c27', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033db78e-d6b1-4c4b-bb37-02f576659ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033db78e-d6b1-4c4b-bb37-02f576659ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fe137d-a052-4c9a-91b4-fd0258d8534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Volume fa329108-3340-47ac-9af1-739ebe548c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa329108-3340-47ac-9af1-739ebe548c27', 'volume_size': 1} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-440824896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa329108-3340-47ac-9af1-739ebe548c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5444bf6836544a4a66c6e2f37282135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:55:21Z,use_quota=True,user_id='abe8163ba6504bb3a28a540706e246fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Creating volume fa329108-3340-47ac-9af1-739ebe548c27 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:55:21 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:55:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:55:21 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 1073741824 Jun 12 04:55:21 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:55:22 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jun 12 04:55:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 1073741824" returned: 0 in 0.856s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:55:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:55:22 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 Jun 12 04:55:22 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:55:23 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fe137d-a052-4c9a-91b4-fd0258d8534c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa329108-3340-47ac-9af1-739ebe548c27', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8311de90-f709-4328-8964-991e16e91b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:55:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Volume volume-fa329108-3340-47ac-9af1-739ebe548c27 (fa329108-3340-47ac-9af1-739ebe548c27): created successfully Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8311de90-f709-4328-8964-991e16e91b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:55:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Flow 'volume_create_manager' (1276f9d8-c5b7-467d-8fa5-0955ce2098a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:55:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5cc43abc-2f7e-4a1e-82ee-a09a88ea6ba2 tempest-TestMinimumBasicScenario-422388943 None] Created volume successfully. Jun 12 04:55:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:55:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:55:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f976b-9840-48f4-9f1c-e3a5264aeda4]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:55:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:55:26 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 Jun 12 04:55:26 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:55:28 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jun 12 04:55:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27" returned: 0 in 1.452s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:55:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.472s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:55:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-fa329108-3340-47ac-9af1-739ebe548c27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73da71f6-d423-446a-b6c9-d197d602ff5b', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:55:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-7dd5f15d-fb36-48ee-8937-a149c98705c3 req-c0ba5b6c-6a9c-4820-9bd6-1a23ce14ddd2 tempest-TestMinimumBasicScenario-422388943 None] attachment_update completed successfully. Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9268b3cf-80d4-4baa-869f-f0e5e5d4cc94 tempest-VolumesActionsTest-518565329 None] Acquiring lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" by "attach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9268b3cf-80d4-4baa-869f-f0e5e5d4cc94 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" acquired by "attach_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:55:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9268b3cf-80d4-4baa-869f-f0e5e5d4cc94 tempest-VolumesActionsTest-518565329 None] Attaching volume 5fe18354-9e2b-426c-9f7a-93135e0dfaf9 to instance 92179128-d4b4-43a6-9ef3-7e7da1c48f5e at mountpoint /dev/vdb on host None. Jun 12 04:55:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9268b3cf-80d4-4baa-869f-f0e5e5d4cc94 tempest-VolumesActionsTest-518565329 None] Attach volume completed successfully. Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9268b3cf-80d4-4baa-869f-f0e5e5d4cc94 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" released by "attach_volume" :: held 0.079s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:55:31 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:55:31 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-60e306f2-4bf8-4024-b3e6-b9c1ff53f620 tempest-VolumesActionsTest-518565329 None] Acquiring lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-detach_volume" by "detach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-60e306f2-4bf8-4024-b3e6-b9c1ff53f620 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:55:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-60e306f2-4bf8-4024-b3e6-b9c1ff53f620 tempest-VolumesActionsTest-518565329 None] Detaching volume 5fe18354-9e2b-426c-9f7a-93135e0dfaf9 from instance 92179128-d4b4-43a6-9ef3-7e7da1c48f5e. Jun 12 04:55:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-60e306f2-4bf8-4024-b3e6-b9c1ff53f620 tempest-VolumesActionsTest-518565329 None] Detach volume completed successfully. Jun 12 04:55:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-60e306f2-4bf8-4024-b3e6-b9c1ff53f620 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:55:32 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jun 12 04:55:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.628s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:55:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:55:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:55:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:55:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:55:41 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=11,cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:55:41 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:55:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-441f27f2-6842-4bcf-907e-968dab8f44e7 tempest-VolumesActionsTest-518565329 None] Acquiring lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" by "attach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:55:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-441f27f2-6842-4bcf-907e-968dab8f44e7 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" acquired by "attach_volume" :: waited 0.039s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:55:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-441f27f2-6842-4bcf-907e-968dab8f44e7 tempest-VolumesActionsTest-518565329 None] Attaching volume 5fe18354-9e2b-426c-9f7a-93135e0dfaf9 to instance dc57744e-2925-4f86-9423-6f0f60ba9813 at mountpoint /dev/vdb on host None. Jun 12 04:55:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-441f27f2-6842-4bcf-907e-968dab8f44e7 tempest-VolumesActionsTest-518565329 None] Attach volume completed successfully. Jun 12 04:55:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-441f27f2-6842-4bcf-907e-968dab8f44e7 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" released by "attach_volume" :: held 0.165s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:55:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09ce641d-1dc1-4b0d-96ae-282d10778567 tempest-VolumesActionsTest-518565329 None] Acquiring lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-detach_volume" by "detach_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:55:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09ce641d-1dc1-4b0d-96ae-282d10778567 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:55:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-09ce641d-1dc1-4b0d-96ae-282d10778567 tempest-VolumesActionsTest-518565329 None] Detaching volume 5fe18354-9e2b-426c-9f7a-93135e0dfaf9 from instance dc57744e-2925-4f86-9423-6f0f60ba9813. Jun 12 04:55:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-09ce641d-1dc1-4b0d-96ae-282d10778567 tempest-VolumesActionsTest-518565329 None] Detach volume completed successfully. Jun 12 04:55:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-09ce641d-1dc1-4b0d-96ae-282d10778567 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:56:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:06 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333938e-1058-40f8-8032-c3f2db5f9946]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:06 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:06 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:07 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.687s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:07 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197a7a4-af3e-4438-82e8-561e7ae10c4e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:07 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:07 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:08 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.718s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.eb165d5b-8671-47e7-aa4a-cc1f1ef93c531f8_rh33.img {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:08 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.eb165d5b-8671-47e7-aa4a-cc1f1ef93c531f8_rh33.img Jun 12 04:56:08 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:56:14 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.eb165d5b-8671-47e7-aa4a-cc1f1ef93c531f8_rh33.img" returned: 0 in 6.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d2ff5-d339-443d-9706-1f1800a763c9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:15 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:15 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:15 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.982s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:15 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.eb165d5b-8671-47e7-aa4a-cc1f1ef93c531f8_rh33.img {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:56:15 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Converted 1024.00 MB image at 152.13 MB/s Jun 12 04:56:15 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] eb165d5b-8671-47e7-aa4a-cc1f1ef93c53 was raw, no need to convert to raw {{(pid=92320) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 12 04:56:16 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:INSERT=1,cinder:UPDATE=4,cinder:SELECT=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:56:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-69ca8483-a879-4f36-b592-7aa9c32caffe req-afae3242-c0e8-4277-adba-d74f34df0a50 tempest-TestMinimumBasicScenario-422388943 None] Terminate volume connection completed successfully. Jun 12 04:56:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-69ca8483-a879-4f36-b592-7aa9c32caffe req-afae3242-c0e8-4277-adba-d74f34df0a50 tempest-TestMinimumBasicScenario-422388943 None] Deleting attachment 73da71f6-d423-446a-b6c9-d197d602ff5b. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:56:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Acquiring lock "cinder-fa329108-3340-47ac-9af1-739ebe548c27-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:56:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Lock "cinder-fa329108-3340-47ac-9af1-739ebe548c27-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:56:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Acquiring lock "cinder-quobyte-fa329108-3340-47ac-9af1-739ebe548c27" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:56:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Lock "cinder-quobyte-fa329108-3340-47ac-9af1-739ebe548c27" acquired by "delete_volume" :: waited 0.040s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:56:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[03724266-cd37-48ef-ab5d-62047f25ac02]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:20 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 Jun 12 04:56:20 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:21 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27" returned: 0 in 0.817s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:21 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27 Jun 12 04:56:21 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:22 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa329108-3340-47ac-9af1-739ebe548c27" returned: 0 in 0.778s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Lock "cinder-quobyte-fa329108-3340-47ac-9af1-739ebe548c27" released by "delete_volume" :: held 1.680s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Created reservations ['0e2b9b66-f189-4497-9205-30d1d69cb02f', 'cf1f9719-4546-4bf2-8618-e0fa52801545', '994fc789-9c48-43e8-8028-30dc737cb51c', '273f54c0-b83b-4758-b9a3-df3c23320256'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:22 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:56:22 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:23 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.757s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:23 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:56:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Deleted volume successfully. Jun 12 04:56:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d6556834-7bd9-4570-9940-d7fb5d75ed86 tempest-TestMinimumBasicScenario-422388943 None] Lock "cinder-fa329108-3340-47ac-9af1-739ebe548c27-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:31 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:56:31 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:32 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:56:32 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.754s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:56:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:56:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:56:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:56:33 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Flow 'volume_create_manager' (7547a7ae-077d-41ca-a2be-517187ca0e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad886ed-0a04-4adc-8f56-fbf49e170528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad886ed-0a04-4adc-8f56-fbf49e170528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1825669936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf2897f-d141-4286-a141-ee19983c66d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f4a8835f82427a90b37fbf7d18b2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:56:38Z,use_quota=True,user_id='f3e440baf598481ea81d02228699d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51e4bbb-c504-46e4-ac51-d01a2bd5d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51e4bbb-c504-46e4-ac51-d01a2bd5d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f2304f-a8ba-479d-bb23-eced2883d956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f2304f-a8ba-479d-bb23-eced2883d956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf2897f-d141-4286-a141-ee19983c66d8', 'volume_name': 'volume-4cf2897f-d141-4286-a141-ee19983c66d8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a52700-1f48-45a0-a705-f642f0c54d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a52700-1f48-45a0-a705-f642f0c54d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c100aacc-698d-44d8-83f9-44217c01b952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:56:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Volume 4cf2897f-d141-4286-a141-ee19983c66d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf2897f-d141-4286-a141-ee19983c66d8', 'volume_size': 1} Jun 12 04:56:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.240s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Uploaded volume to glance image-id: eb165d5b-8671-47e7-aa4a-cc1f1ef93c53. {{(pid=92320) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1825669936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf2897f-d141-4286-a141-ee19983c66d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f4a8835f82427a90b37fbf7d18b2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:56:38Z,use_quota=True,user_id='f3e440baf598481ea81d02228699d82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Creating volume 4cf2897f-d141-4286-a141-ee19983c66d8 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:56:39 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:39 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 1073741824 Jun 12 04:56:39 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fb8ca8ef-bcfd-4d83-ab04-cf4e6b70563b tempest-VolumesActionsTest-518565329 None] Copy volume to image completed successfully. Jun 12 04:56:39 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 1073741824" returned: 0 in 0.967s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:40 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 Jun 12 04:56:40 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:40 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8" returned: 0 in 0.589s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.124s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c100aacc-698d-44d8-83f9-44217c01b952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf2897f-d141-4286-a141-ee19983c66d8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1075af2-54c1-43ec-8f6d-7e749c80b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3814f43-35ac-45e4-9bac-5e45e8da143f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Volume volume-4cf2897f-d141-4286-a141-ee19983c66d8 (4cf2897f-d141-4286-a141-ee19983c66d8): created successfully Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1075af2-54c1-43ec-8f6d-7e749c80b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:56:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Flow 'volume_create_manager' (7547a7ae-077d-41ca-a2be-517187ca0e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:56:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4b0415ba-a025-4bd3-84a6-87749dfd023e tempest-AttachVolumeShelveTestJSON-1594784273 None] Created volume successfully. Jun 12 04:56:40 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:40 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:41 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.764s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:41 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[64694977-f3bb-4257-9394-910b8dae64a5]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:41 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:41 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:42 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.835s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:42 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img Jun 12 04:56:42 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:47 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img" returned: 0 in 5.499s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde68554-dedd-4bf1-9012-0a013fc18c57]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:47 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:47 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:48 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.962s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:48 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:56:48 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Converted 1024.00 MB image at 186.17 MB/s Jun 12 04:56:48 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] cdd3dc78-260d-452a-8e3e-a3f38a6b0f74 was raw, converting to qcow2 {{(pid=92320) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 12 04:56:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2ca7f-d38e-43de-b292-b90c336711eb]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:48 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img Jun 12 04:56:48 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:49 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img" returned: 0 in 0.685s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:49 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img Jun 12 04:56:49 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:50 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img" returned: 1 in 0.781s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:50 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub Jun 12 04:56:50 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:50 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub" returned: 0 in 0.693s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Image conversion details: src /opt/stack/data/cinder/conversion/5fe18354-9e2b-426c-9f7a-93135e0dfaf9.temp_image.cdd3dc78-260d-452a-8e3e-a3f38a6b0f74vs0a42w2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:56:50 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ce09f-683e-462e-a696-033ace1a8f82]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:51 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub Jun 12 04:56:51 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:51 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khk0y1ub" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.596s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Uploaded volume to glance image-id: cdd3dc78-260d-452a-8e3e-a3f38a6b0f74. {{(pid=92320) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 12 04:56:53 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d6d938f8-edfd-46a6-bb05-42a1b8191694 tempest-VolumesActionsTest-518565329 None] Copy volume to image completed successfully. Jun 12 04:56:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Acquiring lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:56:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:56:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Acquiring lock "cinder-quobyte-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:56:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Lock "cinder-quobyte-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:56:55 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb8c5ec-9e01-4a47-a200-5133ef0a9790]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:56:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:55 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:55 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:56 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.881s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:56 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9 Jun 12 04:56:56 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:56 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" returned: 0 in 0.658s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Lock "cinder-quobyte-5fe18354-9e2b-426c-9f7a-93135e0dfaf9" released by "delete_volume" :: held 1.602s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-99910662-43d6-4dcf-9b62-8d91f2ac700a req-200baa35-8dae-4a79-a6f2-aa4116326ece tempest-AttachVolumeShelveTestJSON-1594784273 None] No connector for attachment 3d660c48-1aa7-48a3-aa62-ce33809a29b5; skipping storage backend terminate_connection call. {{(pid=92320) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5022}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-99910662-43d6-4dcf-9b62-8d91f2ac700a req-200baa35-8dae-4a79-a6f2-aa4116326ece tempest-AttachVolumeShelveTestJSON-1594784273 None] Deleting attachment 3d660c48-1aa7-48a3-aa62-ce33809a29b5. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Created reservations ['5692cee7-8550-4516-8903-7906a47d3b29', '660135f2-e8d1-4f8d-90d2-a3e9afb390ce', '5ec8e6ed-6fd8-4743-8bbe-ff419d006d4f', '0db486d8-8457-44cb-9405-e45f1f6cbb57'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:56:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:56:56 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:56:56 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:56:57 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jun 12 04:56:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.727s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:56:57 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:56:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Deleted volume successfully. Jun 12 04:56:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-07469aa3-4897-4b70-b2f8-ecccd83e5cf8 tempest-VolumesActionsTest-518565329 None] Lock "cinder-5fe18354-9e2b-426c-9f7a-93135e0dfaf9-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (f7a98a36-724a-4c5a-95fd-703495a014f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dac222-179e-4488-9c4b-534f5c16e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dac222-179e-4488-9c4b-534f5c16e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678468911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efed13e-841d-4db0-8fd2-067c4f54de39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:05Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ff4a1b-e4b4-4a29-a575-a14c80b1a243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ff4a1b-e4b4-4a29-a575-a14c80b1a243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff71f2c-01bb-4f7a-a32b-32f62a649d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff71f2c-01bb-4f7a-a32b-32f62a649d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efed13e-841d-4db0-8fd2-067c4f54de39', 'volume_name': 'volume-8efed13e-841d-4db0-8fd2-067c4f54de39', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0e9192-bb98-42f6-ba1a-e6e990d3c23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0e9192-bb98-42f6-ba1a-e6e990d3c23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d875611-dc27-4a37-8399-4f6f6febba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Volume 8efed13e-841d-4db0-8fd2-067c4f54de39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efed13e-841d-4db0-8fd2-067c4f54de39', 'volume_size': 1} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678468911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efed13e-841d-4db0-8fd2-067c4f54de39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:05Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Creating volume 8efed13e-841d-4db0-8fd2-067c4f54de39 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:57:04 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:57:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:04 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 1073741824 Jun 12 04:57:04 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:05 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 1073741824" returned: 0 in 0.853s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:05 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 Jun 12 04:57:05 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:06 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39" returned: 0 in 0.638s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d875611-dc27-4a37-8399-4f6f6febba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efed13e-841d-4db0-8fd2-067c4f54de39', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e250176f-1dad-455e-afbd-60c9b8324110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:06 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Volume volume-8efed13e-841d-4db0-8fd2-067c4f54de39 (8efed13e-841d-4db0-8fd2-067c4f54de39): created successfully Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e250176f-1dad-455e-afbd-60c9b8324110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (f7a98a36-724a-4c5a-95fd-703495a014f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b8e2caa9-939d-42c8-8892-2c41120117c9 tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (c6e5aeed-977e-481d-bf24-0a907740b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7b1e22-3068-4c50-8460-4b44de96b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7b1e22-3068-4c50-8460-4b44de96b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-992530703',display_name='tempest-VolumesGetTest-Volume-24067035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ccf220-51df-4d7c-bb6f-b2daa6269dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:07Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a8870-d6e3-488a-a957-dc1921ff8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a8870-d6e3-488a-a957-dc1921ff8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2c655c-2d44-4cae-bcf5-7c0d346e4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2c655c-2d44-4cae-bcf5-7c0d346e4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ccf220-51df-4d7c-bb6f-b2daa6269dbb', 'volume_name': 'volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e420dc21-b4bf-4ea7-8985-91167fdd824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e420dc21-b4bf-4ea7-8985-91167fdd824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b4bdd0-4c20-4834-9f4e-7ee118eacefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:07 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Volume 97ccf220-51df-4d7c-bb6f-b2daa6269dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb', 'volume_size': 1} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-992530703',display_name='tempest-VolumesGetTest-Volume-24067035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ccf220-51df-4d7c-bb6f-b2daa6269dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:07Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Creating volume 97ccf220-51df-4d7c-bb6f-b2daa6269dbb {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:57:07 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:57:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:07 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb 1073741824 Jun 12 04:57:07 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:08 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb 1073741824" returned: 0 in 0.905s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:08 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb Jun 12 04:57:08 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:09 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b4bdd0-4c20-4834-9f4e-7ee118eacefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff9e10b-9312-49d8-abc4-102b38ae73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Volume volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb (97ccf220-51df-4d7c-bb6f-b2daa6269dbb): created successfully Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff9e10b-9312-49d8-abc4-102b38ae73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (c6e5aeed-977e-481d-bf24-0a907740b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-70cb993a-d7ce-4991-8f79-d8bea8f3fd2a tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-97ccf220-51df-4d7c-bb6f-b2daa6269dbb-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-97ccf220-51df-4d7c-bb6f-b2daa6269dbb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-97ccf220-51df-4d7c-bb6f-b2daa6269dbb" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-97ccf220-51df-4d7c-bb6f-b2daa6269dbb" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e641e-01ae-4882-8a3a-c1bbb64b8168]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:10 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb Jun 12 04:57:10 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:10 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb" returned: 0 in 1.091s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:11 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb Jun 12 04:57:11 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:11 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-97ccf220-51df-4d7c-bb6f-b2daa6269dbb" returned: 0 in 0.695s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-97ccf220-51df-4d7c-bb6f-b2daa6269dbb" released by "delete_volume" :: held 1.850s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Created reservations ['56fdf99c-2463-4d5f-aa60-a3996e5b1327', '92dda18b-1db6-427b-bbdc-034cbac727d6', '37dc2e2a-1c53-4638-a385-f8afcaa34ea8', '37c1da35-42b4-4d38-b6ff-0c4442da27d1'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:11 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:11 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-8efed13e-841d-4db0-8fd2-067c4f54de39-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Lock "cinder-8efed13e-841d-4db0-8fd2-067c4f54de39-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-8efed13e-841d-4db0-8fd2-067c4f54de39" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-8efed13e-841d-4db0-8fd2-067c4f54de39" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce893f0-b31e-4e43-a61a-6d4bf6b7f031]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:12 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 Jun 12 04:57:12 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:12 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.735s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:57:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b6a213fa-857b-413d-8654-2302747fe5c4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-97ccf220-51df-4d7c-bb6f-b2daa6269dbb-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:13 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39" returned: 0 in 0.797s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:13 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39 Jun 12 04:57:13 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:13 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8efed13e-841d-4db0-8fd2-067c4f54de39" returned: 0 in 0.646s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-8efed13e-841d-4db0-8fd2-067c4f54de39" released by "delete_volume" :: held 1.482s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Created reservations ['52b80a29-5f9b-4f6d-82cd-18efa4916799', 'ea20ae41-983a-4fc5-857d-306c069b9b06', '80e6cbb1-d85c-4820-b785-1160e406d0c5', '58f3aeb3-6863-44d8-abf5-cbe789999f23'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:13 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:13 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:14 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.699s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-77354cd3-b1a8-49d8-abd0-0aaef4d84c5a tempest-VolumesGetTest-1404400725 None] Lock "cinder-8efed13e-841d-4db0-8fd2-067c4f54de39-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (f7265031-093e-4b6a-b215-4b9e7ff69dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec67d56a-4bcf-4f1d-bf49-fcbe4067df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec67d56a-4bcf-4f1d-bf49-fcbe4067df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1084499891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b121f34-18a6-4362-9ba1-735b48d43006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:15Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8150007-abf0-46a9-8236-bcd6fc505679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8150007-abf0-46a9-8236-bcd6fc505679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174ea863-4ec6-471d-a60b-306bd781d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174ea863-4ec6-471d-a60b-306bd781d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b121f34-18a6-4362-9ba1-735b48d43006', 'volume_name': 'volume-6b121f34-18a6-4362-9ba1-735b48d43006', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40002b99-354d-4529-9e50-bb00e895acd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40002b99-354d-4529-9e50-bb00e895acd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccd92cc-f19a-4d58-8dd2-ab05e6a93262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:14 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Volume 6b121f34-18a6-4362-9ba1-735b48d43006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b121f34-18a6-4362-9ba1-735b48d43006', 'volume_size': 1} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1084499891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b121f34-18a6-4362-9ba1-735b48d43006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:15Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Creating volume 6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:57:14 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:57:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:14 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 1073741824 Jun 12 04:57:14 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 1073741824" returned: 0 in 0.782s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:15 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:15 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:15 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:16 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 0.587s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccd92cc-f19a-4d58-8dd2-ab05e6a93262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b121f34-18a6-4362-9ba1-735b48d43006', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6516c4-30bd-4ac7-aec1-25aaf3836dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:16 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Volume volume-6b121f34-18a6-4362-9ba1-735b48d43006 (6b121f34-18a6-4362-9ba1-735b48d43006): created successfully Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6516c4-30bd-4ac7-aec1-25aaf3836dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:16 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (f7265031-093e-4b6a-b215-4b9e7ff69dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-992ae21e-fb19-42cf-87b9-8b398e31a369 tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (ee1a0d09-7bd8-479e-a0a3-911ab08d0a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699c79fb-b9b1-4a94-ab4c-99ed4bfb439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699c79fb-b9b1-4a94-ab4c-99ed4bfb439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-4710422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7641650b-294c-4c46-9a3d-0aaffed70972,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6b121f34-18a6-4362-9ba1-735b48d43006,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:17Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310154b6-3cc4-4076-a4f1-40776fff0675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310154b6-3cc4-4076-a4f1-40776fff0675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a792100-d79b-4d78-ac80-ddbf2bb8775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a792100-d79b-4d78-ac80-ddbf2bb8775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7641650b-294c-4c46-9a3d-0aaffed70972', 'volume_name': 'volume-7641650b-294c-4c46-9a3d-0aaffed70972', 'volume_size': 1, 'source_volid': '6b121f34-18a6-4362-9ba1-735b48d43006', 'source_volstatus': 'available'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068ab734-6349-4972-bb6a-5f3f324e47c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068ab734-6349-4972-bb6a-5f3f324e47c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011ead4f-6fd8-4f73-bf7f-e56ab89e93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:17 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Volume 7641650b-294c-4c46-9a3d-0aaffed70972: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7641650b-294c-4c46-9a3d-0aaffed70972', 'volume_size': 1, 'source_volid': '6b121f34-18a6-4362-9ba1-735b48d43006', 'source_volstatus': 'available'} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:17 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Cloning volume 6b121f34-18a6-4362-9ba1-735b48d43006 to volume 7641650b-294c-4c46-9a3d-0aaffed70972 Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Creating offline snapshot ac490da1-2ae8-4382-917b-5fba7359b808 of volume 6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab6f215-db93-498f-8bcc-1c8bc5f3655c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:17 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:17 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:19 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 1.349s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:19 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 1G Jun 12 04:57:19 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:20 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 1G" returned: 0 in 1.298s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b121f34-18a6-4362-9ba1-735b48d43006 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:20 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b121f34-18a6-4362-9ba1-735b48d43006 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 Jun 12 04:57:20 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:21 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b121f34-18a6-4362-9ba1-735b48d43006 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808" returned: 0 in 0.813s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:21 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 is being set with open permissions: ugo+rw Jun 12 04:57:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:21 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 Jun 12 04:57:21 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:21 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808" returned: 0 in 0.694s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:21 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info Jun 12 04:57:21 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:22 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:22 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info is being set with open permissions: ugo+rw Jun 12 04:57:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:22 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info Jun 12 04:57:22 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:23 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.info" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-7641650b-294c-4c46-9a3d-0aaffed70972" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-7641650b-294c-4c46-9a3d-0aaffed70972" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] snapshot: ac490da1-2ae8-4382-917b-5fba7359b808, volume: 7641650b-294c-4c46-9a3d-0aaffed70972, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4648d002-d065-4fb3-b4a2-04f2f79f5a63]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:23 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 Jun 12 04:57:23 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:24 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808" returned: 0 in 0.746s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b121f34-18a6-4362-9ba1-735b48d43006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d43d53-fd79-41b4-ab9b-d8f1bbfe7e80]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:24 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:24 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:24 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 0.706s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 04:57:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:24 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 Jun 12 04:57:24 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:31 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:31 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=43,cinder:SELECT=26,cinder:DELETE=4,cinder:INSERT=10 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:57:31 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=35,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:57:32 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972" returned: 0 in 8.204s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868aead-b45b-4a4d-9f46-4d8efed172c8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:33 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.313s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:57:33 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:33 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:33 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 0.946s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:57:33 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Converted 1024.00 MB image at 124.78 MB/s Jun 12 04:57:33 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 is being set with open permissions: ugo+rw Jun 12 04:57:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:33 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 Jun 12 04:57:33 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:34 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972" returned: 0 in 0.631s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-7641650b-294c-4c46-9a3d-0aaffed70972" released by "_copy_volume_from_snapshot" :: held 11.333s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-ac490da1-2ae8-4382-917b-5fba7359b808" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-ac490da1-2ae8-4382-917b-5fba7359b808" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Deleting offline snapshot ac490da1-2ae8-4382-917b-5fba7359b808 of volume 6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] snapshot_file for this snap is: volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf363d-3d52-43e5-84b3-0806616fdfca]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:34 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 Jun 12 04:57:34 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:35 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808" returned: 0 in 0.700s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b121f34-18a6-4362-9ba1-735b48d43006(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:57:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b594a1bc-8af5-4e3e-afdc-42597bee723f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:35 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:35 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:36 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 0.687s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:36 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 Jun 12 04:57:36 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:36 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808" returned: 0 in 0.697s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:36 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808 Jun 12 04:57:36 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:37 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006.ac490da1-2ae8-4382-917b-5fba7359b808" returned: 0 in 0.604s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-ac490da1-2ae8-4382-917b-5fba7359b808" released by "_delete_snapshot" :: held 2.826s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.831s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011ead4f-6fd8-4f73-bf7f-e56ab89e93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7641650b-294c-4c46-9a3d-0aaffed70972', 'volume_size': 1, 'source_volid': '6b121f34-18a6-4362-9ba1-735b48d43006', 'source_volstatus': 'available'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef4da94-f648-450e-b739-c6ec5d7bb4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:37 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Volume volume-7641650b-294c-4c46-9a3d-0aaffed70972 (7641650b-294c-4c46-9a3d-0aaffed70972): created successfully Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef4da94-f648-450e-b739-c6ec5d7bb4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (ee1a0d09-7bd8-479e-a0a3-911ab08d0a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ba2bfed5-3f89-4b05-9d71-12ecc014e272 tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (ddaa75f4-c735-4210-8bcb-0b4ca009a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832a9dd0-f3d4-4b99-aa52-9eb91fd4bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832a9dd0-f3d4-4b99-aa52-9eb91fd4bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1944245385',display_name='tempest-VolumesGetTest-Volume-2139697730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9039072-1e93-4608-95a0-43a89187511d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:38Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c0d810-3d56-466b-b038-a437cacceef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c0d810-3d56-466b-b038-a437cacceef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c89502-2d1d-4af3-9fcf-d0b3efed629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c89502-2d1d-4af3-9fcf-d0b3efed629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9039072-1e93-4608-95a0-43a89187511d', 'volume_name': 'volume-d9039072-1e93-4608-95a0-43a89187511d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2407851-991c-4a80-958b-2c36ccc3dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2407851-991c-4a80-958b-2c36ccc3dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81255f1f-7725-41a8-9201-37fcd49499ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Volume d9039072-1e93-4608-95a0-43a89187511d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9039072-1e93-4608-95a0-43a89187511d', 'volume_size': 1} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1944245385',display_name='tempest-VolumesGetTest-Volume-2139697730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9039072-1e93-4608-95a0-43a89187511d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:38Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Creating volume d9039072-1e93-4608-95a0-43a89187511d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:57:38 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:57:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:38 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d 1073741824 Jun 12 04:57:38 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:39 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d 1073741824" returned: 0 in 0.775s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:39 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d Jun 12 04:57:39 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:40 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81255f1f-7725-41a8-9201-37fcd49499ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9039072-1e93-4608-95a0-43a89187511d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ade255-510d-4ed7-bfdc-6d13e8641f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Volume volume-d9039072-1e93-4608-95a0-43a89187511d (d9039072-1e93-4608-95a0-43a89187511d): created successfully Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ade255-510d-4ed7-bfdc-6d13e8641f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (ddaa75f4-c735-4210-8bcb-0b4ca009a867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ffcc0b97-5c74-48c4-b192-346d1996ef19 tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-d9039072-1e93-4608-95a0-43a89187511d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Lock "cinder-d9039072-1e93-4608-95a0-43a89187511d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-d9039072-1e93-4608-95a0-43a89187511d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-d9039072-1e93-4608-95a0-43a89187511d" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d5ece-a7b4-4b59-9b87-6c124af69878]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:40 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d Jun 12 04:57:40 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:41 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d" returned: 0 in 0.904s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:41 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d Jun 12 04:57:41 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:42 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d9039072-1e93-4608-95a0-43a89187511d" returned: 0 in 0.812s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-d9039072-1e93-4608-95a0-43a89187511d" released by "delete_volume" :: held 1.759s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Created reservations ['ac893a1a-7b5d-4406-b95c-38d95836f72c', 'ae97f054-41a6-479a-8710-9c16e15a33b0', 'eb8b7c74-17dd-4799-9ba5-717e5f652e2f', '888b014c-9814-47e2-8fa9-92f446ab75a9'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:42 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:42 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-7641650b-294c-4c46-9a3d-0aaffed70972-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Lock "cinder-7641650b-294c-4c46-9a3d-0aaffed70972-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-7641650b-294c-4c46-9a3d-0aaffed70972" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-7641650b-294c-4c46-9a3d-0aaffed70972" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0222bf3-d610-4d30-accb-8ce7584673c1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:43 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 Jun 12 04:57:43 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:43 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:57:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a50473b3-6825-48ce-bf06-bd7a4dfc460a tempest-VolumesGetTest-1404400725 None] Lock "cinder-d9039072-1e93-4608-95a0-43a89187511d-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:44 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972" returned: 0 in 0.803s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:44 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972 Jun 12 04:57:44 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:44 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7641650b-294c-4c46-9a3d-0aaffed70972" returned: 0 in 0.589s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-7641650b-294c-4c46-9a3d-0aaffed70972" released by "delete_volume" :: held 1.461s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Created reservations ['94c3d6b0-8d54-4855-b32c-265423cb56bd', 'e6161916-d2e4-4fc6-8523-958036384b1d', '895238d4-fd1e-47d6-8b70-a55d257affca', 'd5b5ac4a-4c20-403b-8b1b-70380f8ea306'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:44 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:44 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:45 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.588s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-67c3043a-7f27-4e24-a890-c178cd3775e0 tempest-VolumesGetTest-1404400725 None] Lock "cinder-7641650b-294c-4c46-9a3d-0aaffed70972-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-6b121f34-18a6-4362-9ba1-735b48d43006-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Lock "cinder-6b121f34-18a6-4362-9ba1-735b48d43006-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-6b121f34-18a6-4362-9ba1-735b48d43006" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-6b121f34-18a6-4362-9ba1-735b48d43006" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a1b22-b813-4b10-83eb-09f2ea2054df]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:45 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:45 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:46 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 0.718s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:46 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006 Jun 12 04:57:46 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:46 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-6b121f34-18a6-4362-9ba1-735b48d43006" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-6b121f34-18a6-4362-9ba1-735b48d43006" released by "delete_volume" :: held 1.351s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Created reservations ['28058629-7f48-4e60-a09b-066ac2f2a95f', '60746dfd-d5f5-4573-868a-c8eee8d23bd3', 'f2388199-1dc1-4313-9778-c2b841739bfb', '6612102a-c20e-48ae-95a8-80b813b68b6c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:46 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:46 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:47 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:47 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:47 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:57:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef1593e-3448-46de-9fdb-55fa21fb4199 tempest-VolumesGetTest-1404400725 None] Lock "cinder-6b121f34-18a6-4362-9ba1-735b48d43006-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (6a79d151-0146-4ce3-927b-ba1e6d8a31d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937a6d75-4905-424f-b16d-9b513e61c621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937a6d75-4905-424f-b16d-9b513e61c621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1193774426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203c13e5-812a-4273-a1d7-684decd8a724,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:48Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f2273b-87d8-4a19-9277-40d76f1787ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f2273b-87d8-4a19-9277-40d76f1787ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd870f8-16db-4cca-8d9e-33def7231f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd870f8-16db-4cca-8d9e-33def7231f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '203c13e5-812a-4273-a1d7-684decd8a724', 'volume_name': 'volume-203c13e5-812a-4273-a1d7-684decd8a724', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af764305-f910-4c50-b460-10c34d161c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af764305-f910-4c50-b460-10c34d161c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8408cc33-f969-4283-88bc-5197307827dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:48 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Volume 203c13e5-812a-4273-a1d7-684decd8a724: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-203c13e5-812a-4273-a1d7-684decd8a724', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Trying to clone 203c13e5-812a-4273-a1d7-684decd8a724 from image 23fce906-aa03-46a6-9408-5b9570e89c54 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "cinder-4cf2897f-d141-4286-a141-ee19983c66d8-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-4cf2897f-d141-4286-a141-ee19983c66d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "cinder-quobyte-4cf2897f-d141-4286-a141-ee19983c66d8" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-quobyte-4cf2897f-d141-4286-a141-ee19983c66d8" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7525a7-98ec-4828-9b33-9b3b9af4d194]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 04:57:49 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Image download 20.69 MB at 20.69 MB/s Jun 12 04:57:49 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 Jun 12 04:57:49 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f6903f-d2ca-4d7a-bcfb-6478c749f211]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:49 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD Jun 12 04:57:49 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:49 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8" returned: 0 in 0.848s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:49 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8 Jun 12 04:57:49 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:49 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD" returned: 0 in 0.690s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 is fetched for user a3f788819a4d48b68c524a7d04603106. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b67ec-f010-421e-ab19-df4c853cec6c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:50 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD Jun 12 04:57:50 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:50 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4cf2897f-d141-4286-a141-ee19983c66d8" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-quobyte-4cf2897f-d141-4286-a141-ee19983c66d8" released by "delete_volume" :: held 1.521s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Created reservations ['0ebae05d-0aef-4cad-b66d-a04f2fd33b8f', 'cebbc72a-f07f-4320-8130-5ba7e7f08f4c', '9b8880a0-b652-43f1-9f90-1de6f358f879', '35a2bc9b-b1bf-4752-a89d-05672bcd437a'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:50 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:50 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:50 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD" returned: 0 in 0.714s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1193774426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203c13e5-812a-4273-a1d7-684decd8a724,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:48Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Creating volume 203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:57:50 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:57:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:50 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 1073741824 Jun 12 04:57:50 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "cinder-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:51 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.643s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:51 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Deleted volume successfully. Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c776ac91-7373-4481-bb46-507c23e7cdb5 tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-4cf2897f-d141-4286-a141-ee19983c66d8-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "cinder-quobyte-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-quobyte-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b98c8e0-b051-4296-93b4-93a8fbd3ff19]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:51 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 Jun 12 04:57:51 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:51 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 1073741824" returned: 0 in 0.873s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:51 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:57:51 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:52 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" returned: 0 in 0.780s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:52 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2 Jun 12 04:57:52 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:52 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Attempting download of 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume 203c13e5-812a-4273-a1d7-684decd8a724. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7eca3-9c4b-4b13-bec3-8f71974cb136]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:52 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp Jun 12 04:57:52 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:52 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" returned: 0 in 0.606s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-quobyte-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2" released by "delete_volume" :: held 1.426s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Created reservations ['eecd770b-d0be-487d-b6f6-3590e115a94b', '6e73a833-68a6-4954-9d40-ac374e9074dc', '43243d97-001c-43ed-8b03-e6f8a6c3b35f', 'ea1aa8ad-87ea-422f-84dc-e8607808f062'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:52 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:57:52 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:52 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp" returned: 0 in 0.714s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:53 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp Jun 12 04:57:53 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:53 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.602s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:57:53 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Deleted volume successfully. Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-65dd0789-e0c8-4011-a98f-47e5a5c0cd1f tempest-AttachVolumeShelveTestJSON-1594784273 None] Lock "cinder-425ad7a8-1c3d-4558-8c6b-1a86af5b60e2-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:57:53 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp" returned: 1 in 0.740s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_lpsadtmp' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1941ac53-e024-4cfd-b09a-02be429e8c62]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:53 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD Jun 12 04:57:53 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:54 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD" returned: 0 in 0.749s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] 23fce906-aa03-46a6-9408-5b9570e89c54 was qcow2, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:54 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:57:54 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Flow 'volume_create_manager' (01c1a912-802b-44ff-b01c-06622246e250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4da30c8-fdd5-4f78-9b83-4b1d2902a46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4da30c8-fdd5-4f78-9b83-4b1d2902a46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1400011235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38be586-3fc0-4072-818b-045a30603dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1268d09b82a84ecfb10dd9a54d554e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:55Z,use_quota=True,user_id='7b11b1baa9e541e1b56a0efc55f577fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36184114-10d7-4960-a723-b7a6ec21e15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36184114-10d7-4960-a723-b7a6ec21e15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb3bcb3-db9e-407a-9939-8d7ad91144be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb3bcb3-db9e-407a-9939-8d7ad91144be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38be586-3fc0-4072-818b-045a30603dd8', 'volume_name': 'volume-e38be586-3fc0-4072-818b-045a30603dd8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ab1b64-17f7-4bc6-8792-a87371fa5e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ab1b64-17f7-4bc6-8792-a87371fa5e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1e857a-f3f8-4779-99cc-942748622096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:54 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Volume e38be586-3fc0-4072-818b-045a30603dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38be586-3fc0-4072-818b-045a30603dd8', 'volume_size': 1} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1400011235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38be586-3fc0-4072-818b-045a30603dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1268d09b82a84ecfb10dd9a54d554e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:57:55Z,use_quota=True,user_id='7b11b1baa9e541e1b56a0efc55f577fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Creating volume e38be586-3fc0-4072-818b-045a30603dd8 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:57:54 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:57:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:54 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 1073741824 Jun 12 04:57:54 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:55 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 1073741824" returned: 0 in 1.016s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:55 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 Jun 12 04:57:55 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:56 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 0 in 1.924s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_pdfeemp5devstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:57:56 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Converted 112.00 MB image at 58.15 MB/s Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:56 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 1G Jun 12 04:57:56 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:56 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1e857a-f3f8-4779-99cc-942748622096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38be586-3fc0-4072-818b-045a30603dd8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc97b2c6-c46c-4e2a-afdb-917bf3761c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Volume volume-e38be586-3fc0-4072-818b-045a30603dd8 (e38be586-3fc0-4072-818b-045a30603dd8): created successfully Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc97b2c6-c46c-4e2a-afdb-917bf3761c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Flow 'volume_create_manager' (01c1a912-802b-44ff-b01c-06622246e250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5c2b4c2c-0730-42ab-8fa4-01172fa767c6 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Created volume successfully. Jun 12 04:57:57 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 1G" returned: 0 in 0.834s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69c2bd-d0ad-439f-93df-a7aba06e23d1]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:57:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:57 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:57:57 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:58 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 0 in 0.751s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:57:58 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:57:58 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:57:58 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 1 in 0.742s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Downloaded image 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume 203c13e5-812a-4273-a1d7-684decd8a724 successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 for user a3f788819a4d48b68c524a7d04603106 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Marking volume 203c13e5-812a-4273-a1d7-684decd8a724 as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Copying metadata from image 23fce906-aa03-46a6-9408-5b9570e89c54 to 203c13e5-812a-4273-a1d7-684decd8a724. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Creating volume glance metadata for volume 203c13e5-812a-4273-a1d7-684decd8a724 backed by image 23fce906-aa03-46a6-9408-5b9570e89c54 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8408cc33-f969-4283-88bc-5197307827dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203c13e5-812a-4273-a1d7-684decd8a724', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd54ce-1ca4-49db-a35b-821720c38690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:57:58 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Volume volume-203c13e5-812a-4273-a1d7-684decd8a724 (203c13e5-812a-4273-a1d7-684decd8a724): created successfully Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd54ce-1ca4-49db-a35b-821720c38690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:57:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (6a79d151-0146-4ce3-927b-ba1e6d8a31d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:57:58 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1b4e479e-cf32-4b01-abe0-7af530490624 tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee98b98-015f-4c35-a502-7bcf85f1716c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:00 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 Jun 12 04:58:00 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (864f84a3-4bd6-4a70-af53-d612e132733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d012fd9b-8fef-43e6-abdd-220efeb7f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d012fd9b-8fef-43e6-abdd-220efeb7f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1300584399',display_name='tempest-VolumesGetTest-Volume-191675165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48699068-5100-444c-8edd-95f5b10c6e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:01Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b4cd9c-8e4b-437c-aa19-03c24b81759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b4cd9c-8e4b-437c-aa19-03c24b81759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44fc229-e49a-44ec-b5cc-e47d65581987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44fc229-e49a-44ec-b5cc-e47d65581987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48699068-5100-444c-8edd-95f5b10c6e2b', 'volume_name': 'volume-48699068-5100-444c-8edd-95f5b10c6e2b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba265e51-f62f-45a4-89b9-60a78d4d97e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba265e51-f62f-45a4-89b9-60a78d4d97e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea387a6f-24ab-4c1f-a1ff-cd88d672bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:00 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Volume 48699068-5100-444c-8edd-95f5b10c6e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48699068-5100-444c-8edd-95f5b10c6e2b', 'volume_size': 1} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:00 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8" returned: 0 in 0.802s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1300584399',display_name='tempest-VolumesGetTest-Volume-191675165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48699068-5100-444c-8edd-95f5b10c6e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d136737f6cb4c5aa47d92590ae6adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:01Z,use_quota=True,user_id='a3f788819a4d48b68c524a7d04603106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Creating volume 48699068-5100-444c-8edd-95f5b10c6e2b {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:00 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:00 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b 1073741824 Jun 12 04:58:00 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-e38be586-3fc0-4072-818b-045a30603dd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18b09986-bb3a-45ef-8348-bf24c2be2e22', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 04:58:01 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-29322611-1994-4993-b81b-e86d46581b23 req-d1325088-e9ff-4e95-9fd7-bfe8700e0258 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] attachment_update completed successfully. Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Flow 'volume_create_manager' (68567a5b-cb4d-40fc-a938-650c09ff6b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab31f64f-6797-495b-b3f2-14847499b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab31f64f-6797-495b-b3f2-14847499b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1006575407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b605d3-b970-43ec-adba-73e093149f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad238a2625f745c192d2d245d2b2bf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:01Z,use_quota=True,user_id='a0cb074c50da43e2821fe2eb15df6c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f660e7c3-abb8-4ad4-a5fa-c0c3e4295dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f660e7c3-abb8-4ad4-a5fa-c0c3e4295dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e2b60-ad46-476a-8095-97dab7d9bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e2b60-ad46-476a-8095-97dab7d9bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b605d3-b970-43ec-adba-73e093149f9a', 'volume_name': 'volume-92b605d3-b970-43ec-adba-73e093149f9a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8262542e-0191-4702-8946-24d64efb44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8262542e-0191-4702-8946-24d64efb44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96ae1ef-da8c-4003-90de-d706da4bc2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:01 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Volume 92b605d3-b970-43ec-adba-73e093149f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b605d3-b970-43ec-adba-73e093149f9a', 'volume_size': 1} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:01 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b 1073741824" returned: 0 in 0.876s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:01 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b Jun 12 04:58:01 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:02 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b" returned: 0 in 0.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.907s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1006575407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b605d3-b970-43ec-adba-73e093149f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad238a2625f745c192d2d245d2b2bf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:01Z,use_quota=True,user_id='a0cb074c50da43e2821fe2eb15df6c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Creating volume 92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:02 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea387a6f-24ab-4c1f-a1ff-cd88d672bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48699068-5100-444c-8edd-95f5b10c6e2b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fa2a67-74da-40cd-9967-207261e9e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:02 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a 1073741824 Jun 12 04:58:02 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Volume volume-48699068-5100-444c-8edd-95f5b10c6e2b (48699068-5100-444c-8edd-95f5b10c6e2b): created successfully Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fa2a67-74da-40cd-9967-207261e9e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Flow 'volume_create_manager' (864f84a3-4bd6-4a70-af53-d612e132733c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-387b2754-3c53-4f3e-9d77-7f5ea87272dc tempest-VolumesGetTest-1404400725 None] Created volume successfully. Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-48699068-5100-444c-8edd-95f5b10c6e2b-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-48699068-5100-444c-8edd-95f5b10c6e2b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-48699068-5100-444c-8edd-95f5b10c6e2b" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-48699068-5100-444c-8edd-95f5b10c6e2b" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8615272-2962-4320-89c5-996d721ff901]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:03 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b Jun 12 04:58:03 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:03 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a 1073741824" returned: 0 in 0.858s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:03 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a Jun 12 04:58:03 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:03 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b" returned: 0 in 0.832s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:03 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b Jun 12 04:58:03 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:03 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a" returned: 0 in 0.654s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96ae1ef-da8c-4003-90de-d706da4bc2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b605d3-b970-43ec-adba-73e093149f9a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4baaa5d-f636-48fc-b696-1c3dfd5a663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Volume volume-92b605d3-b970-43ec-adba-73e093149f9a (92b605d3-b970-43ec-adba-73e093149f9a): created successfully Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4baaa5d-f636-48fc-b696-1c3dfd5a663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Flow 'volume_create_manager' (68567a5b-cb4d-40fc-a938-650c09ff6b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:04 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-6252fa3e-ddc2-43a4-86fb-8079cab4f49f req-7e90bd9b-258a-4fb7-887a-7e18ceb7e3d3 tempest-VolumesSnapshotsTestJSON-1069430105 None] Created volume successfully. Jun 12 04:58:04 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-48699068-5100-444c-8edd-95f5b10c6e2b" returned: 0 in 0.630s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-48699068-5100-444c-8edd-95f5b10c6e2b" released by "delete_volume" :: held 1.508s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Created reservations ['42011025-4d00-412f-8b11-c4575b485441', '8b296829-281b-41bb-af7a-7b81e4e6d9fc', 'afaa4e81-20d5-4521-837d-91c13a9327be', 'ca7b6430-bcaa-4b90-a7dc-2675ac4b0c7b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:04 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:04 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Creating offline snapshot 155d8b62-d890-4fff-bac3-23e84a51fee3 of volume 92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40a006-7a2f-4a44-9adf-a9eff651760b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:05 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a Jun 12 04:58:05 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-203c13e5-812a-4273-a1d7-684decd8a724-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Lock "cinder-203c13e5-812a-4273-a1d7-684decd8a724-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Acquiring lock "cinder-quobyte-203c13e5-812a-4273-a1d7-684decd8a724" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-203c13e5-812a-4273-a1d7-684decd8a724" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:05 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.829s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:05 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-31d7d736-1cdf-4bbb-9276-c853d67cd9a4 tempest-VolumesGetTest-1404400725 None] Lock "cinder-48699068-5100-444c-8edd-95f5b10c6e2b-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7610dd4-c89e-450b-92b0-834fda2fd924]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:05 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:58:05 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:06 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a" returned: 0 in 0.937s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:06 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 1G Jun 12 04:58:06 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:06 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 0 in 0.797s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:06 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:58:06 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:06 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 1G" returned: 0 in 0.757s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b605d3-b970-43ec-adba-73e093149f9a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:06 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b605d3-b970-43ec-adba-73e093149f9a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 Jun 12 04:58:06 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:07 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 1 in 0.707s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:07 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724 Jun 12 04:58:07 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:07 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b605d3-b970-43ec-adba-73e093149f9a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3" returned: 0 in 0.709s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:07 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 is being set with open permissions: ugo+rw Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:07 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 Jun 12 04:58:07 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-a56b4cb9-a724-426f-ae97-573599e00f3e req-5dc0a5f8-242d-415c-9f35-68041ef9fc87 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Terminate volume connection completed successfully. Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-a56b4cb9-a724-426f-ae97-573599e00f3e req-5dc0a5f8-242d-415c-9f35-68041ef9fc87 tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Deleting attachment 18b09986-bb3a-45ef-8348-bf24c2be2e22. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 04:58:07 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-203c13e5-812a-4273-a1d7-684decd8a724" returned: 0 in 0.657s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Lock "cinder-quobyte-203c13e5-812a-4273-a1d7-684decd8a724" released by "delete_volume" :: held 2.258s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Created reservations ['adc2161c-95ea-4440-9e39-c9f3f946d8e1', '618ea8c7-02a7-4106-81e1-04ed58cdaaf3', 'b27d3933-05ec-46d0-86ad-2019f3acd1bc', '23b72ee5-539a-45ff-a20f-1e30cb640328'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:07 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:07 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:08 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3" returned: 0 in 0.629s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:08 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info Jun 12 04:58:08 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:08 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.599s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Deleted volume successfully. Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-34d2d8dd-c792-4a4b-b3d4-b87074f8e87a tempest-VolumesGetTest-1404400725 None] Lock "cinder-203c13e5-812a-4273-a1d7-684decd8a724-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:08 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:08 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info is being set with open permissions: ugo+rw Jun 12 04:58:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:08 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info Jun 12 04:58:08 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:09 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.info" returned: 0 in 0.606s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-18cba53b-e7ec-4530-bf3c-cba88fcd72c5 req-93d7eeb4-915f-4af4-b7ea-04dc9279e55b tempest-VolumesSnapshotsTestJSON-1069430105 None] Create snapshot completed successfully Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "cinder-155d8b62-d890-4fff-bac3-23e84a51fee3-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-155d8b62-d890-4fff-bac3-23e84a51fee3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "cinder-quobyte-92b605d3-b970-43ec-adba-73e093149f9a" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-quobyte-92b605d3-b970-43ec-adba-73e093149f9a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "cinder-quobyte-155d8b62-d890-4fff-bac3-23e84a51fee3" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-quobyte-155d8b62-d890-4fff-bac3-23e84a51fee3" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Deleting offline snapshot 155d8b62-d890-4fff-bac3-23e84a51fee3 of volume 92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] snapshot_file for this snap is: volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[342456d6-90e8-4424-a27c-4766ab3f09d0]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Acquiring lock "cinder-e38be586-3fc0-4072-818b-045a30603dd8-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "cinder-e38be586-3fc0-4072-818b-045a30603dd8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Acquiring lock "cinder-quobyte-e38be586-3fc0-4072-818b-045a30603dd8" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "cinder-quobyte-e38be586-3fc0-4072-818b-045a30603dd8" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:09 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 Jun 12 04:58:09 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[683fb631-dda4-41b8-8a9e-379e403d60d2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:10 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 Jun 12 04:58:10 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:10 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3" returned: 0 in 0.870s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92b605d3-b970-43ec-adba-73e093149f9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:58:10 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[70154093-e22d-42b8-b5bd-0f460dfe85f1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:10 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8" returned: 0 in 0.828s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:10 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a Jun 12 04:58:10 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:10 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8 Jun 12 04:58:10 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:11 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e38be586-3fc0-4072-818b-045a30603dd8" returned: 0 in 0.684s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:11 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a" returned: 0 in 0.796s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "cinder-quobyte-e38be586-3fc0-4072-818b-045a30603dd8" released by "delete_volume" :: held 1.591s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:11 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 Jun 12 04:58:11 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Created reservations ['a10adc80-7414-42cd-9968-7975657dde31', 'e2db7d91-5fa6-40c7-94cb-b655477625ad', '883a15c9-9f7c-46fa-8bcd-ef2199753f31', 'bede867d-1ed2-4fcb-ad3e-da3615b958b2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:11 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:11 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (a8ee6a09-ebb3-44dc-bf14-9e6b796cbc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0a82af-c818-4a9a-8cc5-33380eb75e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0a82af-c818-4a9a-8cc5-33380eb75e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212621674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d3f305-cef4-42bd-afa5-122af40c3128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:12Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e523e2b-02da-4dd5-9e2e-6161552b29f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e523e2b-02da-4dd5-9e2e-6161552b29f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ba61e-2a25-4fb1-aa3a-e2833cc229d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ba61e-2a25-4fb1-aa3a-e2833cc229d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d3f305-cef4-42bd-afa5-122af40c3128', 'volume_name': 'volume-c3d3f305-cef4-42bd-afa5-122af40c3128', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26877d53-b6d8-4ee2-a034-05a3f2907f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26877d53-b6d8-4ee2-a034-05a3f2907f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2063849-10a0-4a73-9f68-5c67ea80bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:11 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume c3d3f305-cef4-42bd-afa5-122af40c3128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d3f305-cef4-42bd-afa5-122af40c3128', 'volume_size': 1} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212621674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d3f305-cef4-42bd-afa5-122af40c3128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:12Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating volume c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:11 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:11 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 1073741824 Jun 12 04:58:11 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:12 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3" returned: 0 in 0.826s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:12 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.663s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Deleted volume successfully. Jun 12 04:58:12 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3 Jun 12 04:58:12 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f573fedd-aac1-4d9c-84d4-d12c447220cb tempest-TestServerVolumeAttachScenarioOldVersion-841763038 None] Lock "cinder-e38be586-3fc0-4072-818b-045a30603dd8-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:12 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 1073741824" returned: 0 in 0.883s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:12 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 Jun 12 04:58:12 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:13 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a.155d8b62-d890-4fff-bac3-23e84a51fee3" returned: 0 in 0.655s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-quobyte-155d8b62-d890-4fff-bac3-23e84a51fee3" released by "_delete_snapshot" :: held 3.269s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-quobyte-92b605d3-b970-43ec-adba-73e093149f9a" released by "delete_snapshot" :: held 3.310s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.quota [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Created reservations ['cc8432c1-e52c-4fc2-a5f8-99ce105e9f4e', '3f8face5-862c-45c1-b9d9-3a33f8589b96', '3ff3119a-bae6-406a-b109-2be90e744df6', '0a093286-9e4c-41b5-9e2b-a9e5159f730c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:13 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Delete snapshot completed successfully. Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-fa8d16d4-59e5-47fb-acb9-072487ffbd20 req-ce019b7b-36c0-4b03-ab0d-0020bf2f3c60 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-155d8b62-d890-4fff-bac3-23e84a51fee3-delete_snapshot" released by "delete_snapshot" :: held 3.470s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:13 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2063849-10a0-4a73-9f68-5c67ea80bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d3f305-cef4-42bd-afa5-122af40c3128', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccebc6e1-131e-4752-91a3-c9794e13bf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:13 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume volume-c3d3f305-cef4-42bd-afa5-122af40c3128 (c3d3f305-cef4-42bd-afa5-122af40c3128): created successfully Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccebc6e1-131e-4752-91a3-c9794e13bf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (a8ee6a09-ebb3-44dc-bf14-9e6b796cbc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:13 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fc9e65ad-4afc-4430-9357-bb36ee13ae74 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created volume successfully. Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "cinder-92b605d3-b970-43ec-adba-73e093149f9a-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating offline snapshot 7a3caf0f-d7c0-4473-9415-a392483633a5 of volume c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-92b605d3-b970-43ec-adba-73e093149f9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d76bc17-05d0-4270-a0be-43c311512033]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "cinder-quobyte-92b605d3-b970-43ec-adba-73e093149f9a" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-quobyte-92b605d3-b970-43ec-adba-73e093149f9a" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[647caebd-5aa6-491c-ac06-5c84b9fafcd3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:14 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 Jun 12 04:58:14 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:14 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a Jun 12 04:58:14 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:14 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:14 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 1G Jun 12 04:58:14 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:15 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a" returned: 0 in 0.758s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:15 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a Jun 12 04:58:15 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:15 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-92b605d3-b970-43ec-adba-73e093149f9a" returned: 0 in 0.703s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:15 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 1G" returned: 0 in 0.840s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d3f305-cef4-42bd-afa5-122af40c3128 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-quobyte-92b605d3-b970-43ec-adba-73e093149f9a" released by "delete_volume" :: held 1.527s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:15 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d3f305-cef4-42bd-afa5-122af40c3128 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 Jun 12 04:58:15 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG cinder.quota [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Created reservations ['753a3873-54b4-4a92-830f-aa0ede5c0547', '69abc231-fb99-4585-9b0b-0fae2540e080', 'f163deba-065e-4d52-aa94-4a5692084ef5', '90ddc401-cbb3-4f51-b5f5-d9cc75a7ee3b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:15 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:15 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:16 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d3f305-cef4-42bd-afa5-122af40c3128 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5" returned: 0 in 0.665s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:16 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 is being set with open permissions: ugo+rw Jun 12 04:58:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:16 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 Jun 12 04:58:16 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:16 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:16 devstack cinder-volume[92320]: DEBUG cinder.manager [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Deleted volume successfully. Jun 12 04:58:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-0ba3d67b-8a73-415f-a2c3-e71e4041af68 req-4f12356e-d3d3-45ca-bb4f-fbe7485b9815 tempest-VolumesSnapshotsTestJSON-1069430105 None] Lock "cinder-92b605d3-b970-43ec-adba-73e093149f9a-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:17 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5" returned: 0 in 0.640s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:17 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info Jun 12 04:58:17 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:17 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:17 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info is being set with open permissions: ugo+rw Jun 12 04:58:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:17 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info Jun 12 04:58:17 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:18 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.info" returned: 0 in 0.628s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-100a9c23-14b4-4e35-a424-133dfc9a17d2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Create snapshot completed successfully Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (610586d6-283e-4f62-af54-02470b44edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459f2bd1-34c4-469d-a00c-8256d74058f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459f2bd1-34c4-469d-a00c-8256d74058f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654821013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a8b65d-33ac-4446-9ed4-86ddee0e6588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:20Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad465e5e-505f-4a41-ab51-24e2c2e6823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad465e5e-505f-4a41-ab51-24e2c2e6823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68eefc9-b05e-40cf-a832-c481869f4c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68eefc9-b05e-40cf-a832-c481869f4c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a8b65d-33ac-4446-9ed4-86ddee0e6588', 'volume_name': 'volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0396d76f-b46f-437b-a4e6-3cc73c067a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0396d76f-b46f-437b-a4e6-3cc73c067a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d792339-74d5-4ed6-ad50-0c17f22389e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:19 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume 17a8b65d-33ac-4446-9ed4-86ddee0e6588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588', 'volume_size': 1} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654821013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a8b65d-33ac-4446-9ed4-86ddee0e6588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:20Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating volume 17a8b65d-33ac-4446-9ed4-86ddee0e6588 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:19 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:19 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 1073741824 Jun 12 04:58:19 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (9e0c77b9-f9a2-4d50-9c46-ce73eed90f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56153269-224f-4b89-97cd-aecec807a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56153269-224f-4b89-97cd-aecec807a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789370965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671ec103-c654-4fd6-8f3c-2b11fbaf3577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:20Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fd754c-29d3-492b-a47b-4f8a49d90e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fd754c-29d3-492b-a47b-4f8a49d90e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8c36a6-ebb9-4ad8-b58b-31371c70857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8c36a6-ebb9-4ad8-b58b-31371c70857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671ec103-c654-4fd6-8f3c-2b11fbaf3577', 'volume_name': 'volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4588b085-3c27-4d0f-aa04-0b998a614548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4588b085-3c27-4d0f-aa04-0b998a614548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfd53d0-ee8a-4c9a-bd6a-79e9336af3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume 671ec103-c654-4fd6-8f3c-2b11fbaf3577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577', 'volume_size': 1} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Flow 'volume_create_manager' (9d7602ff-1eba-4a5b-a91d-23b39aa91af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7b4829-3662-4d4e-b4d1-40f371a85a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7b4829-3662-4d4e-b4d1-40f371a85a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-230567353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22ba9b8-8c02-4ed5-ac22-276394a40702,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd7dca2cce84dbfaa9b801c74e930cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:20Z,use_quota=True,user_id='e8022be121c74860bfc88011ae9fd9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de7d5a9-172c-4ea9-9b85-de592991a577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de7d5a9-172c-4ea9-9b85-de592991a577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e802dd-ba62-4ac7-826f-579efa0a2868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e802dd-ba62-4ac7-826f-579efa0a2868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22ba9b8-8c02-4ed5-ac22-276394a40702', 'volume_name': 'volume-d22ba9b8-8c02-4ed5-ac22-276394a40702', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7bbad6-2a6e-4d6e-ba8d-5765d357ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7bbad6-2a6e-4d6e-ba8d-5765d357ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38eaae55-496c-409a-9c01-6fd610905363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Volume d22ba9b8-8c02-4ed5-ac22-276394a40702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22ba9b8-8c02-4ed5-ac22-276394a40702', 'volume_size': 1} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (a6aaa427-d3e6-4f79-97d8-34c6bc01875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f27132-4e5c-4d5d-8551-bc04dce9952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f27132-4e5c-4d5d-8551-bc04dce9952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022391101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21955c19-bf4a-4290-8134-77f2977867d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:21Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b98c83-7a96-4be5-9d47-64e32a5aeb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b98c83-7a96-4be5-9d47-64e32a5aeb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfa1da8-5d84-487a-b06e-05d760a97afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfa1da8-5d84-487a-b06e-05d760a97afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21955c19-bf4a-4290-8134-77f2977867d6', 'volume_name': 'volume-21955c19-bf4a-4290-8134-77f2977867d6', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f8906f-a0d5-4f39-82a1-d613f759879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f8906f-a0d5-4f39-82a1-d613f759879d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d984ca2f-8db1-4e83-9897-dd3082ad1e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:20 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume 21955c19-bf4a-4290-8134-77f2977867d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21955c19-bf4a-4290-8134-77f2977867d6', 'volume_size': 1} Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:20 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 1073741824" returned: 0 in 1.176s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:21 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 Jun 12 04:58:21 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (9faa2201-ca30-4dc4-8ca8-0961b7882e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9d65f-a4e3-485e-b2fd-1803391b9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9d65f-a4e3-485e-b2fd-1803391b9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217460616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a81ab7-a7a3-4a80-baba-e5ff75538cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:21Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbb318e-e1d9-49e5-b79e-eb4fbb8a5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbb318e-e1d9-49e5-b79e-eb4fbb8a5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7f8d04-a079-434d-8ca3-f493c3dd632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7f8d04-a079-434d-8ca3-f493c3dd632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a81ab7-a7a3-4a80-baba-e5ff75538cc5', 'volume_name': 'volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c899814f-607c-4243-bfe8-7cae1034a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c899814f-607c-4243-bfe8-7cae1034a578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a3ec1e-b6eb-4918-b976-e0ea7d585c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume 24a81ab7-a7a3-4a80-baba-e5ff75538cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5', 'volume_size': 1} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (c4328fb3-a26e-45ef-a14c-d6e5640461ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bf02fe-d264-478a-832f-8b95a9279993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bf02fe-d264-478a-832f-8b95a9279993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104155290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac18d00a-6fcc-4ece-a52f-df8e628bd8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:21Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39483469-c820-4b57-bb51-13f4f889aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39483469-c820-4b57-bb51-13f4f889aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b457e6-3e68-4ab4-b6ef-ea6fcf303559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b457e6-3e68-4ab4-b6ef-ea6fcf303559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac18d00a-6fcc-4ece-a52f-df8e628bd8e5', 'volume_name': 'volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1949e96-5b5b-4d92-9573-0ab8fd9f8b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1949e96-5b5b-4d92-9573-0ab8fd9f8b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4b4da9-f70f-416c-8884-8cfc7fbbf723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume ac18d00a-6fcc-4ece-a52f-df8e628bd8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5', 'volume_size': 1} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:21 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588" returned: 0 in 0.831s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789370965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671ec103-c654-4fd6-8f3c-2b11fbaf3577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:20Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating volume 671ec103-c654-4fd6-8f3c-2b11fbaf3577 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:21 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d792339-74d5-4ed6-ad50-0c17f22389e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 1073741824 Jun 12 04:58:21 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c6675c-be8f-4522-a5b5-866161a89924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 (17a8b65d-33ac-4446-9ed4-86ddee0e6588): created successfully Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c6675c-be8f-4522-a5b5-866161a89924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (610586d6-283e-4f62-af54-02470b44edb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f0163a59-29ff-4dae-ab28-d93ba45ce68d tempest-CreateVolumesFromSnapshotTest-789158600 None] Created volume successfully. Jun 12 04:58:22 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 1073741824" returned: 0 in 0.876s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:22 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 Jun 12 04:58:22 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:23 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577" returned: 0 in 0.632s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.917s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-230567353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22ba9b8-8c02-4ed5-ac22-276394a40702,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd7dca2cce84dbfaa9b801c74e930cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:20Z,use_quota=True,user_id='e8022be121c74860bfc88011ae9fd9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Creating volume d22ba9b8-8c02-4ed5-ac22-276394a40702 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:23 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:23 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 1073741824 Jun 12 04:58:23 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfd53d0-ee8a-4c9a-bd6a-79e9336af3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95512b2-afde-4614-b62a-85244fc1a0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 (671ec103-c654-4fd6-8f3c-2b11fbaf3577): created successfully Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95512b2-afde-4614-b62a-85244fc1a0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (9e0c77b9-f9a2-4d50-9c46-ce73eed90f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4e2e36aa-4769-47ce-8996-6ca5f6d4aeb2 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created volume successfully. Jun 12 04:58:24 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 1073741824" returned: 0 in 0.851s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:24 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 Jun 12 04:58:24 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:24 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702" returned: 0 in 0.658s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.148s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022391101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21955c19-bf4a-4290-8134-77f2977867d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:21Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating volume 21955c19-bf4a-4290-8134-77f2977867d6 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:25 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:25 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 1073741824 Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38eaae55-496c-409a-9c01-6fd610905363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22ba9b8-8c02-4ed5-ac22-276394a40702', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:25 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a289fa-5290-44e0-a2af-284dc42b693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:25 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Volume volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 (d22ba9b8-8c02-4ed5-ac22-276394a40702): created successfully Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a289fa-5290-44e0-a2af-284dc42b693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Flow 'volume_create_manager' (9d7602ff-1eba-4a5b-a91d-23b39aa91af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:25 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-5304670b-e1e3-4fef-828c-163c6c950ef4 req-460bf6c8-6360-4b47-b65e-edc90f6b4b3e tempest-VolumesGetTestJSON-2079600184 None] Created volume successfully. Jun 12 04:58:25 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 1073741824" returned: 0 in 0.813s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:25 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 Jun 12 04:58:25 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Acquiring lock "cinder-d22ba9b8-8c02-4ed5-ac22-276394a40702-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Lock "cinder-d22ba9b8-8c02-4ed5-ac22-276394a40702-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Acquiring lock "cinder-quobyte-d22ba9b8-8c02-4ed5-ac22-276394a40702" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Lock "cinder-quobyte-d22ba9b8-8c02-4ed5-ac22-276394a40702" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e427c75b-0689-41c2-872d-a9fbc09a68eb]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:26 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 Jun 12 04:58:26 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:26 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6" returned: 0 in 0.655s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.300s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217460616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a81ab7-a7a3-4a80-baba-e5ff75538cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:21Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating volume 24a81ab7-a7a3-4a80-baba-e5ff75538cc5 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:26 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:26 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 1073741824 Jun 12 04:58:26 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d984ca2f-8db1-4e83-9897-dd3082ad1e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21955c19-bf4a-4290-8134-77f2977867d6', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b999210-d84f-4b6d-818d-dfd0f69e2cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:26 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume volume-21955c19-bf4a-4290-8134-77f2977867d6 (21955c19-bf4a-4290-8134-77f2977867d6): created successfully Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b999210-d84f-4b6d-818d-dfd0f69e2cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (a6aaa427-d3e6-4f79-97d8-34c6bc01875b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-119c604e-cf71-4196-98ea-80b437cb5560 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created volume successfully. Jun 12 04:58:27 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702" returned: 0 in 0.773s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:27 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702 Jun 12 04:58:27 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:27 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 1073741824" returned: 0 in 0.829s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:27 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 Jun 12 04:58:27 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:27 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-d22ba9b8-8c02-4ed5-ac22-276394a40702" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Lock "cinder-quobyte-d22ba9b8-8c02-4ed5-ac22-276394a40702" released by "delete_volume" :: held 1.466s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG cinder.quota [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Created reservations ['35010002-76fd-4b2d-a6c0-28d6e806c8ed', 'db952655-9340-4ad4-9902-120b720fc65f', '665a49d5-6ffe-444c-9cbd-886c10f6ce4d', '0bdb4f71-a5dc-4383-b279-4815598e0fc6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:27 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:27 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:28 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.408s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104155290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac18d00a-6fcc-4ece-a52f-df8e628bd8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae20ff502abc476584241b21be04426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:21Z,use_quota=True,user_id='3a08b271ea134b32abbb0f948a8a2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Creating volume ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:28 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a3ec1e-b6eb-4918-b976-e0ea7d585c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:28 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 1073741824 Jun 12 04:58:28 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42846f0b-72e5-4846-8a52-ae238c5f2dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:28 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 (24a81ab7-a7a3-4a80-baba-e5ff75538cc5): created successfully Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42846f0b-72e5-4846-8a52-ae238c5f2dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (9faa2201-ca30-4dc4-8ca8-0961b7882e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1c9f1908-c5d2-4dc2-af8b-7be641d32570 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created volume successfully. Jun 12 04:58:28 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.780s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.manager [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Deleted volume successfully. Jun 12 04:58:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [req-d9f70c2c-808b-4b61-ba92-58106cad4a61 req-64a59053-f3af-492e-88e5-e0c1526a1fc2 tempest-VolumesGetTestJSON-2079600184 None] Lock "cinder-d22ba9b8-8c02-4ed5-ac22-276394a40702-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:29 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 1073741824" returned: 0 in 1.053s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:29 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 Jun 12 04:58:29 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:29 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5" returned: 0 in 0.687s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4b4da9-f70f-416c-8884-8cfc7fbbf723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed2e9c6-b901-4f06-a082-3418207f4dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:29 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Volume volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 (ac18d00a-6fcc-4ece-a52f-df8e628bd8e5): created successfully Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed2e9c6-b901-4f06-a082-3418207f4dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Flow 'volume_create_manager' (c4328fb3-a26e-45ef-a14c-d6e5640461ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0495f687-f06f-47f4-b928-c09144ccd257 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created volume successfully. Jun 12 04:58:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:30 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03c865-fd88-47d9-91f7-15767729e779]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:30 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 Jun 12 04:58:30 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:31 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5" returned: 0 in 0.772s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:31 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5 Jun 12 04:58:31 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:31 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:31 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:32 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5" returned: 0 in 0.699s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5" released by "delete_volume" :: held 1.526s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=127,cinder:SELECT=109,cinder:INSERT=32,cinder:DELETE=9 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=137,cinder:SELECT=101,cinder:DELETE=16,cinder:INSERT=40 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['95d0a3bd-01c4-4380-ad40-5420b95a3113', 'b437911b-e2bc-4dad-b739-c875e7241a4e', '36d9501c-a890-4db9-8a40-ebb0bdbb927f', '6f70b6a3-d482-409b-b239-5f15d1d95e56'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:32 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:32 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:32 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.685s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-24a81ab7-a7a3-4a80-baba-e5ff75538cc5-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-24a81ab7-a7a3-4a80-baba-e5ff75538cc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-24a81ab7-a7a3-4a80-baba-e5ff75538cc5" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-24a81ab7-a7a3-4a80-baba-e5ff75538cc5" acquired by "delete_volume" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f47cade-2264-4afb-a06a-f55533608f33]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:32 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.700s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:33 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:33 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleted volume successfully. Jun 12 04:58:33 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-db869ad5-a2a0-4d8d-b7d1-a0d9ea84ad53 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-ac18d00a-6fcc-4ece-a52f-df8e628bd8e5-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:33 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 Jun 12 04:58:33 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:33 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5" returned: 0 in 0.770s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:33 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5 Jun 12 04:58:33 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:34 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-24a81ab7-a7a3-4a80-baba-e5ff75538cc5" returned: 0 in 0.671s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-24a81ab7-a7a3-4a80-baba-e5ff75538cc5" released by "delete_volume" :: held 1.502s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['4a851361-6bb6-42a5-a2b5-568558d7e2c2', '5465f937-6b62-4dcc-ab1b-2b9cf96d2bc0', '835a3245-ceef-4a66-9e83-5864d169b3b9', 'fe73a2f5-6f41-4cd6-9ee5-1715fa8299cc'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:34 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:34 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-21955c19-bf4a-4290-8134-77f2977867d6-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-21955c19-bf4a-4290-8134-77f2977867d6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-21955c19-bf4a-4290-8134-77f2977867d6" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-21955c19-bf4a-4290-8134-77f2977867d6" acquired by "delete_volume" :: waited 0.032s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2f05f-2f7d-49a5-881f-452b2334b0e2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:35 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 Jun 12 04:58:35 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:35 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.819s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:35 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleted volume successfully. Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-113b97b1-ca94-42d4-ba34-f8e5d0316e35 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-24a81ab7-a7a3-4a80-baba-e5ff75538cc5-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Flow 'volume_create_manager' (5d46e881-76b4-40d8-8866-21f8d0e259bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e77f8a-49d1-489b-8526-43dbefbabccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e77f8a-49d1-489b-8526-43dbefbabccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86b2808-b539-49f7-8d18-7b942964365c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb67f161c2c4ebc9c7f4f7d6526443e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:36Z,use_quota=True,user_id='5d5ca6ce01f743649e5e437bd29fc0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d6525b-68f3-4557-9a5f-f557299ca3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d6525b-68f3-4557-9a5f-f557299ca3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bc48fb-6131-461f-9d1c-3a08e7a5b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:35 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bc48fb-6131-461f-9d1c-3a08e7a5b53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b86b2808-b539-49f7-8d18-7b942964365c', 'volume_name': 'volume-b86b2808-b539-49f7-8d18-7b942964365c', 'volume_size': 1, 'image_id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41f819b0-74cf-44a0-8442-5552aebbb4a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b54e5cd48d7ee32471a6476db82c41d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddb67f161c2c4ebc9c7f4f7d6526443e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '261956c216cc6148dd3773f4c60d3c0d258619d45f8cabd9a02d4dfc7da29e5ded396b15449b4c021358824ad0f91520fc83a6e37837b19a3d8f2fe093d07829', 'id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'created_at': datetime.datetime(2026, 6, 12, 2, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41f819b0-74cf-44a0-8442-5552aebbb4a4/file', 'properties': {}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393dd12a-1a4a-4e16-8898-bf9bf0b3c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393dd12a-1a4a-4e16-8898-bf9bf0b3c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:36 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fdba66-2c41-42b4-8d9c-8b5b2a21a249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Volume b86b2808-b539-49f7-8d18-7b942964365c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b86b2808-b539-49f7-8d18-7b942964365c', 'volume_size': 1, 'image_id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41f819b0-74cf-44a0-8442-5552aebbb4a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b54e5cd48d7ee32471a6476db82c41d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddb67f161c2c4ebc9c7f4f7d6526443e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '261956c216cc6148dd3773f4c60d3c0d258619d45f8cabd9a02d4dfc7da29e5ded396b15449b4c021358824ad0f91520fc83a6e37837b19a3d8f2fe093d07829', 'id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'created_at': datetime.datetime(2026, 6, 12, 2, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41f819b0-74cf-44a0-8442-5552aebbb4a4/file', 'properties': {}}, 'image_service': } Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Trying to clone b86b2808-b539-49f7-8d18-7b942964365c from image 41f819b0-74cf-44a0-8442-5552aebbb4a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41f819b0-74cf-44a0-8442-5552aebbb4a4', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6" returned: 0 in 0.817s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:36 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6 Jun 12 04:58:36 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 04:58:36 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Image download 0.00 MB at 0.00 MB/s Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8e599-b620-4c06-b01c-964f246be8d1]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:36 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD Jun 12 04:58:36 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:36 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-21955c19-bf4a-4290-8134-77f2977867d6" returned: 0 in 0.655s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-21955c19-bf4a-4290-8134-77f2977867d6" released by "delete_volume" :: held 1.517s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['2fc95c24-3dad-4176-aef0-b1cc18b0aa6b', '127410f7-2abd-4b58-850f-1e3b60f77cc7', 'a97c11b8-9500-46ea-8850-cfe67a76d687', '26264ad8-747b-4d53-b09c-2e7a1669b8fc'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:36 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:36 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:36 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:37 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD Jun 12 04:58:37 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-671ec103-c654-4fd6-8f3c-2b11fbaf3577-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-671ec103-c654-4fd6-8f3c-2b11fbaf3577-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-671ec103-c654-4fd6-8f3c-2b11fbaf3577" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-671ec103-c654-4fd6-8f3c-2b11fbaf3577" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8894e8a2-2d1f-4895-b50c-bd41f931aed2]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:37 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.652s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleted volume successfully. Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f2ea2d58-9a03-475c-934c-1fd537c74444 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-21955c19-bf4a-4290-8134-77f2977867d6-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:37 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Temporary image 41f819b0-74cf-44a0-8442-5552aebbb4a4 is fetched for user 5d5ca6ce01f743649e5e437bd29fc0ca. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 04:58:37 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 Jun 12 04:58:37 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ddb641-3f15-4885-9280-b8e9525d95e8]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:37 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD Jun 12 04:58:37 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:38 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577" returned: 0 in 0.768s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:38 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577 Jun 12 04:58:38 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:38 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:38 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD Jun 12 04:58:38 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:38 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-671ec103-c654-4fd6-8f3c-2b11fbaf3577" returned: 0 in 0.654s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-671ec103-c654-4fd6-8f3c-2b11fbaf3577" released by "delete_volume" :: held 1.475s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['fe3e8204-2a6c-4459-a5e5-04b69538d996', '7d981121-2e9c-4755-8b58-cd58949c1f01', 'e126b2c8-7f55-4717-b801-516995a8de33', 'ac75b99b-a455-4ef0-a235-4ca35d2036dc'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:39 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:39 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:39 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD" returned: 1 in 0.788s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86b2808-b539-49f7-8d18-7b942964365c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb67f161c2c4ebc9c7f4f7d6526443e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:36Z,use_quota=True,user_id='5d5ca6ce01f743649e5e437bd29fc0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Creating volume b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:39 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:39 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c 1073741824 Jun 12 04:58:39 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-17a8b65d-33ac-4446-9ed4-86ddee0e6588-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-17a8b65d-33ac-4446-9ed4-86ddee0e6588-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-17a8b65d-33ac-4446-9ed4-86ddee0e6588" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-17a8b65d-33ac-4446-9ed4-86ddee0e6588" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f439e370-dae9-427f-b02b-cc9b7fcf6247]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:39 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.706s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleted volume successfully. Jun 12 04:58:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1cd276a9-de27-41e3-879d-6f1087df27ae tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-671ec103-c654-4fd6-8f3c-2b11fbaf3577-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:40 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 Jun 12 04:58:40 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:40 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c 1073741824" returned: 0 in 0.923s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:40 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:40 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:40 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588" returned: 0 in 0.873s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:40 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588 Jun 12 04:58:40 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:40 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Attempting download of 41f819b0-74cf-44a0-8442-5552aebbb4a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41f819b0-74cf-44a0-8442-5552aebbb4a4', 'metadata': {}}])) to volume b86b2808-b539-49f7-8d18-7b942964365c. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[584040cd-b496-4b3c-baad-ff79e7b41bad]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:41 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh Jun 12 04:58:41 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:41 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-17a8b65d-33ac-4446-9ed4-86ddee0e6588" returned: 0 in 0.631s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-17a8b65d-33ac-4446-9ed4-86ddee0e6588" released by "delete_volume" :: held 1.565s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['f8189789-4ee9-4bd0-b681-b8f805e46bee', 'a40f66e4-e13a-400c-af99-8242899faeb4', 'ad6ae1d2-e68d-46db-abd9-66128969c9bb', '53924b4d-8b45-4aae-a56a-3bf2c110ba4e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:41 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:41 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:41 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh" returned: 0 in 0.724s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:41 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh Jun 12 04:58:41 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-7a3caf0f-d7c0-4473-9415-a392483633a5-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-7a3caf0f-d7c0-4473-9415-a392483633a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-c3d3f305-cef4-42bd-afa5-122af40c3128" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-c3d3f305-cef4-42bd-afa5-122af40c3128" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-7a3caf0f-d7c0-4473-9415-a392483633a5" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-7a3caf0f-d7c0-4473-9415-a392483633a5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleting offline snapshot 7a3caf0f-d7c0-4473-9415-a392483633a5 of volume c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] snapshot_file for this snap is: volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb3d14f-973d-42b5-a55b-ff5cee06f50e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:42 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:42 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 Jun 12 04:58:42 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.665s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:42 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleted volume successfully. Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ba98c3a7-b133-4987-b913-e74ad55048e4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-17a8b65d-33ac-4446-9ed4-86ddee0e6588-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:42 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh" returned: 1 in 0.767s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41f819b0-74cf-44a0-8442-5552aebbb4a4_zv_y46fh' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce45e82-46f5-4e69-852a-5d0034816326]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:42 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD Jun 12 04:58:42 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:42 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5" returned: 0 in 0.840s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3d3f305-cef4-42bd-afa5-122af40c3128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db1c3a-c5e2-411b-adbd-ed6ab52e6db5]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:43 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 Jun 12 04:58:43 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:43 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:43 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD Jun 12 04:58:43 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:43 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128" returned: 0 in 0.794s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:43 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 Jun 12 04:58:43 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:43 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] 41f819b0-74cf-44a0-8442-5552aebbb4a4 was raw, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 04:58:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:43 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:43 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:44 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5" returned: 0 in 0.820s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:44 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5 Jun 12 04:58:44 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:44 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 0 in 0.791s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:44 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41f819b0-74cf-44a0-8442-5552aebbb4a4_my_cnh4bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 04:58:44 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Converted 0.00 MB image at 0.00 MB/s Jun 12 04:58:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:44 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c 1G Jun 12 04:58:44 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:45 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128.7a3caf0f-d7c0-4473-9415-a392483633a5" returned: 0 in 0.658s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-7a3caf0f-d7c0-4473-9415-a392483633a5" released by "_delete_snapshot" :: held 3.262s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-c3d3f305-cef4-42bd-afa5-122af40c3128" released by "delete_snapshot" :: held 3.294s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['19138c13-3c18-460a-b764-1697475f45d3', 'cb171b73-da61-45ed-b411-8d2a89f6d9d3', 'e19b4209-c5ee-4011-8357-2ad38b637dd7', 'a2f35a2a-1611-437b-a649-1814a1161e40'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Delete snapshot completed successfully. Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fc09ce39-0ede-4669-96de-f5c747da1ac4 tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-7a3caf0f-d7c0-4473-9415-a392483633a5-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:45 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c 1G" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2201cb75-2184-4761-9920-c4755040a722]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:45 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:45 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-c3d3f305-cef4-42bd-afa5-122af40c3128-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-c3d3f305-cef4-42bd-afa5-122af40c3128-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "cinder-quobyte-c3d3f305-cef4-42bd-afa5-122af40c3128" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:46 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 0 in 0.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-c3d3f305-cef4-42bd-afa5-122af40c3128" acquired by "delete_volume" :: waited 0.030s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e12bc-e2b1-479b-902d-1de767d31bcd]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:46 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:46 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:46 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 Jun 12 04:58:46 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:47 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 1 in 0.760s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Downloaded image 41f819b0-74cf-44a0-8442-5552aebbb4a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/41f819b0-74cf-44a0-8442-5552aebbb4a4', 'metadata': {}}])) to volume b86b2808-b539-49f7-8d18-7b942964365c successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Temporary image 41f819b0-74cf-44a0-8442-5552aebbb4a4 for user 5d5ca6ce01f743649e5e437bd29fc0ca is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Marking volume b86b2808-b539-49f7-8d18-7b942964365c as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Copying metadata from image 41f819b0-74cf-44a0-8442-5552aebbb4a4 to b86b2808-b539-49f7-8d18-7b942964365c. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Creating volume glance metadata for volume b86b2808-b539-49f7-8d18-7b942964365c backed by image 41f819b0-74cf-44a0-8442-5552aebbb4a4 with: {'image_id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b54e5cd48d7ee32471a6476db82c41d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fdba66-2c41-42b4-8d9c-8b5b2a21a249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86b2808-b539-49f7-8d18-7b942964365c', 'volume_size': 1, 'image_id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41f819b0-74cf-44a0-8442-5552aebbb4a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b54e5cd48d7ee32471a6476db82c41d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddb67f161c2c4ebc9c7f4f7d6526443e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '261956c216cc6148dd3773f4c60d3c0d258619d45f8cabd9a02d4dfc7da29e5ded396b15449b4c021358824ad0f91520fc83a6e37837b19a3d8f2fe093d07829', 'id': '41f819b0-74cf-44a0-8442-5552aebbb4a4', 'created_at': datetime.datetime(2026, 6, 12, 2, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41f819b0-74cf-44a0-8442-5552aebbb4a4/file', 'properties': {}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:47 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5ad78e-293c-4439-a304-93edbf48845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128" returned: 0 in 0.800s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:47 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Volume volume-b86b2808-b539-49f7-8d18-7b942964365c (b86b2808-b539-49f7-8d18-7b942964365c): created successfully Jun 12 04:58:47 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128 Jun 12 04:58:47 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5ad78e-293c-4439-a304-93edbf48845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Flow 'volume_create_manager' (5d46e881-76b4-40d8-8866-21f8d0e259bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:47 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9694fb95-6592-4b1e-9042-38158666e180 tempest-VolumeImageDependencyTests-487965075 None] Created volume successfully. Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Acquiring lock "cinder-b86b2808-b539-49f7-8d18-7b942964365c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Lock "cinder-b86b2808-b539-49f7-8d18-7b942964365c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Acquiring lock "cinder-quobyte-b86b2808-b539-49f7-8d18-7b942964365c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Lock "cinder-quobyte-b86b2808-b539-49f7-8d18-7b942964365c" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f387a-b5eb-4915-9d2d-bc5d900cea0a]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:47 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c3d3f305-cef4-42bd-afa5-122af40c3128" returned: 0 in 0.680s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:47 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:47 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-quobyte-c3d3f305-cef4-42bd-afa5-122af40c3128" released by "delete_volume" :: held 1.563s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Created reservations ['c1548a3f-2177-46ba-a24d-e35ecd29d4bd', 'b78ac40d-aae7-4492-9620-164f0d0837db', 'ccad8072-33a2-40a7-a7e7-28bd8aeed0f6', 'd40479e9-e996-48d9-adf6-d5d1b488d090'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:48 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:48 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:48 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 0 in 0.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:48 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:48 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:48 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:48 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:48 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Deleted volume successfully. Jun 12 04:58:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37fe1387-8e34-4114-837a-27afb517568b tempest-CreateVolumesFromSnapshotTest-789158600 None] Lock "cinder-c3d3f305-cef4-42bd-afa5-122af40c3128-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:49 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 1 in 0.807s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 04:58:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:49 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c Jun 12 04:58:49 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:49 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b86b2808-b539-49f7-8d18-7b942964365c" returned: 0 in 0.693s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Lock "cinder-quobyte-b86b2808-b539-49f7-8d18-7b942964365c" released by "delete_volume" :: held 2.305s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Created reservations ['3f7a40aa-41e6-464a-bd3b-7aba8c456505', 'cd747fea-eb84-494e-beee-b13d177db6cf', '463217e7-c12c-410f-b34b-2b80b4739904', '690af40c-cf1f-48a6-ac73-67210469d442'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:50 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:50 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:50 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Flow 'volume_create_manager' (ec167679-fc04-4bdc-8fdf-68156e56995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde398a1-a8b9-4b8b-9d92-6f542134ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.652s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:50 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Deleted volume successfully. Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde398a1-a8b9-4b8b-9d92-6f542134ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-764028927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0d8c54-d498-49a4-9925-95e7a40851d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34d4b76ef324455bd3d176bbb5ce79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:51Z,use_quota=True,user_id='bd62d3096da24fe7ad0a518e8e68009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c74686-ce82-4575-ab46-c9b3f04d9a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c74686-ce82-4575-ab46-c9b3f04d9a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c376f9-9241-40ed-b890-b61a6734550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c376f9-9241-40ed-b890-b61a6734550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0d8c54-d498-49a4-9925-95e7a40851d3', 'volume_name': 'volume-da0d8c54-d498-49a4-9925-95e7a40851d3', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4564b563-c82e-4fae-97ff-8b2227cb9973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4564b563-c82e-4fae-97ff-8b2227cb9973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4e5c55-3df6-4300-b00a-f6d77ce1eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:50 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Volume da0d8c54-d498-49a4-9925-95e7a40851d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0d8c54-d498-49a4-9925-95e7a40851d3', 'volume_size': 1} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-764028927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0d8c54-d498-49a4-9925-95e7a40851d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34d4b76ef324455bd3d176bbb5ce79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:51Z,use_quota=True,user_id='bd62d3096da24fe7ad0a518e8e68009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Creating volume da0d8c54-d498-49a4-9925-95e7a40851d3 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:50 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:50 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 1073741824 Jun 12 04:58:50 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4244065f-80e2-4ff3-a145-370ac587dcb4 tempest-VolumeImageDependencyTests-487965075 None] Lock "cinder-b86b2808-b539-49f7-8d18-7b942964365c-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (4156d3f9-f121-4639-9463-2b6644943440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3f6d47-d940-4acc-ba63-daf5f2fd2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3f6d47-d940-4acc-ba63-daf5f2fd2a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655051593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd34b64b-00cd-4401-8c86-4be18e505f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:52Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5c082b-fab1-4b76-b841-ccbb05cb2ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5c082b-fab1-4b76-b841-ccbb05cb2ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbcb70f-858c-487a-b90f-eb146c0d93c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbcb70f-858c-487a-b90f-eb146c0d93c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd34b64b-00cd-4401-8c86-4be18e505f4c', 'volume_name': 'volume-fd34b64b-00cd-4401-8c86-4be18e505f4c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3efc1-4a90-4fe2-833f-e12519ffb89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d3efc1-4a90-4fe2-833f-e12519ffb89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91965478-a500-486e-ba39-5b8514dd0491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:51 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume fd34b64b-00cd-4401-8c86-4be18e505f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd34b64b-00cd-4401-8c86-4be18e505f4c', 'volume_size': 1} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:51 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 1073741824" returned: 0 in 0.965s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:51 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 Jun 12 04:58:51 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:52 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3" returned: 0 in 0.607s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655051593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd34b64b-00cd-4401-8c86-4be18e505f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:52Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Creating volume fd34b64b-00cd-4401-8c86-4be18e505f4c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:52 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4e5c55-3df6-4300-b00a-f6d77ce1eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0d8c54-d498-49a4-9925-95e7a40851d3', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:52 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c 1073741824 Jun 12 04:58:52 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3f4904-1960-42f2-bbfe-c0407698c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:52 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Volume volume-da0d8c54-d498-49a4-9925-95e7a40851d3 (da0d8c54-d498-49a4-9925-95e7a40851d3): created successfully Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3f4904-1960-42f2-bbfe-c0407698c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Flow 'volume_create_manager' (ec167679-fc04-4bdc-8fdf-68156e56995b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-08fadfcd-92fa-4a42-8678-3eb43b2308ba tempest-VolumeQuotasAdminTestJSON-570642305 None] Created volume successfully. Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "cinder-da0d8c54-d498-49a4-9925-95e7a40851d3-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "cinder-da0d8c54-d498-49a4-9925-95e7a40851d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "cinder-quobyte-da0d8c54-d498-49a4-9925-95e7a40851d3" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:58:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "cinder-quobyte-da0d8c54-d498-49a4-9925-95e7a40851d3" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff657b6-5d61-4a1c-a5f6-464668a980d3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:53 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 Jun 12 04:58:53 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:53 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c 1073741824" returned: 0 in 0.779s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:53 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c Jun 12 04:58:53 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:53 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3" returned: 0 in 0.702s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:53 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3 Jun 12 04:58:53 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:53 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91965478-a500-486e-ba39-5b8514dd0491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd34b64b-00cd-4401-8c86-4be18e505f4c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4177f015-2cdb-41d5-b5c6-b945a545a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:53 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume volume-fd34b64b-00cd-4401-8c86-4be18e505f4c (fd34b64b-00cd-4401-8c86-4be18e505f4c): created successfully Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4177f015-2cdb-41d5-b5c6-b945a545a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:53 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (4156d3f9-f121-4639-9463-2b6644943440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:53 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f5d30250-0357-4496-94d1-0f67abcc9272 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created volume successfully. Jun 12 04:58:54 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da0d8c54-d498-49a4-9925-95e7a40851d3" returned: 0 in 0.584s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "cinder-quobyte-da0d8c54-d498-49a4-9925-95e7a40851d3" released by "delete_volume" :: held 1.322s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Created reservations ['ca681b74-bfa2-45c8-bda1-1021436d9664', '7195bacb-66a8-44cd-83f8-4772f4673dbb', '06ec4136-3ccf-4713-9378-d3631bdf1e90', '8eb8952b-6171-4845-a851-7c064bb0a392'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:54 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:58:54 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:54 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.565s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:58:54 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Deleted volume successfully. Jun 12 04:58:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fa94fb05-fec9-44f6-9013-a9ea09e1ed55 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "cinder-da0d8c54-d498-49a4-9925-95e7a40851d3-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (275f139f-91f4-4bf9-b62a-33d81713a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626979a3-beef-43ed-90f2-575227a7c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626979a3-beef-43ed-90f2-575227a7c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673116376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:55Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab66149-caf2-44a4-b579-543c3283f83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab66149-caf2-44a4-b579-543c3283f83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6877d8e-760b-4a49-bacf-65740ea1b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6877d8e-760b-4a49-bacf-65740ea1b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223', 'volume_name': 'volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d04e601-b464-4bdf-b7ea-33774af82604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d04e601-b464-4bdf-b7ea-33774af82604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51952043-e3f6-46dc-abf9-b704bf29c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223', 'volume_size': 1} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673116376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:55Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Creating volume da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:55 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:55 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 1073741824 Jun 12 04:58:55 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (5363eee5-badc-40c7-af89-ee8be766a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12825fbc-c7af-4e47-8f4d-8758cc5fdecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12825fbc-c7af-4e47-8f4d-8758cc5fdecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119607834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b5dcff-d7c1-4593-8f5b-210826c6abbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f422b44-d5dc-420a-b37e-21cd1c4b0e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f422b44-d5dc-420a-b37e-21cd1c4b0e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f395e65-65c8-4711-a5ab-f593c05e400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f395e65-65c8-4711-a5ab-f593c05e400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b5dcff-d7c1-4593-8f5b-210826c6abbe', 'volume_name': 'volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8b3b3f-8763-4234-8779-604d9883322f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8b3b3f-8763-4234-8779-604d9883322f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dbedb0-451c-4b80-9220-f48bfcaff4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume 07b5dcff-d7c1-4593-8f5b-210826c6abbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe', 'volume_size': 1} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Flow 'volume_create_manager' (a41077a0-3322-438d-bedc-0fc66f7e3dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ac7876-f7bb-45ce-bd84-3ed9fb00a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ac7876-f7bb-45ce-bd84-3ed9fb00a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-757329957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5998773-0250-4496-9dcf-127132eca57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34d4b76ef324455bd3d176bbb5ce79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='bd62d3096da24fe7ad0a518e8e68009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251bc6c-381e-4334-b5f8-c8f42014c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251bc6c-381e-4334-b5f8-c8f42014c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12968cb2-5016-4d4f-a162-d0350f4bcc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12968cb2-5016-4d4f-a162-d0350f4bcc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5998773-0250-4496-9dcf-127132eca57d', 'volume_name': 'volume-b5998773-0250-4496-9dcf-127132eca57d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a95e20-f816-464c-9743-fa679baede79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a95e20-f816-464c-9743-fa679baede79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c141eee9-262f-4a8d-901f-3861217e112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Volume b5998773-0250-4496-9dcf-127132eca57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5998773-0250-4496-9dcf-127132eca57d', 'volume_size': 1} Jun 12 04:58:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (90604f05-8cd4-41c0-b1fe-36bdafd2b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b705f33-47cb-4283-a8a1-6a8cc7ae56f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b705f33-47cb-4283-a8a1-6a8cc7ae56f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256272617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c563c3fc-b29a-4f33-9d43-d4604b17a18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d1165d-588e-4809-9db8-ef7bcfb4bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d1165d-588e-4809-9db8-ef7bcfb4bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b1bc6f-cd70-4fe7-868f-32d5b92b98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b1bc6f-cd70-4fe7-868f-32d5b92b98bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c563c3fc-b29a-4f33-9d43-d4604b17a18d', 'volume_name': 'volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008c0044-5671-487b-bb7e-5cb9abca75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008c0044-5671-487b-bb7e-5cb9abca75b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58558d7-4656-4152-978a-e4f935a4e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume c563c3fc-b29a-4f33-9d43-d4604b17a18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d', 'volume_size': 1} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:56 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 1073741824" returned: 0 in 0.941s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:56 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 Jun 12 04:58:56 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (abb87028-4bff-403e-92ed-0762b88aedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce8ee15-5152-427c-9854-fd4fad4c9535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce8ee15-5152-427c-9854-fd4fad4c9535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2020238299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1bacf8-cf29-4dd3-8a5e-7b44becdee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d06424-689f-48a6-baa6-3109797436bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d06424-689f-48a6-baa6-3109797436bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652d2992-2fea-46b7-b6dc-6ffb1fad910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652d2992-2fea-46b7-b6dc-6ffb1fad910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1bacf8-cf29-4dd3-8a5e-7b44becdee25', 'volume_name': 'volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d2f7f8-aac4-4652-bc77-7fe5eacbb77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d2f7f8-aac4-4652-bc77-7fe5eacbb77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8f7c01-c756-496e-8c41-26dc6d15fc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume 4a1bacf8-cf29-4dd3-8a5e-7b44becdee25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25', 'volume_size': 1} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (eab85cf2-07a7-4241-92f1-11afe68fd1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4a9da0-81ef-4205-bf5e-5f1128927914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223" returned: 0 in 0.596s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119607834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b5dcff-d7c1-4593-8f5b-210826c6abbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Creating volume 07b5dcff-d7c1-4593-8f5b-210826c6abbe {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:56 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4a9da0-81ef-4205-bf5e-5f1128927914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-768299127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7e258c-aec0-4710-8cfe-cd86e66bfc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:57Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe 1073741824 Jun 12 04:58:56 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f0a921-8364-44a0-9d1f-3038d7eb3ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f0a921-8364-44a0-9d1f-3038d7eb3ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330e0e9e-44d0-4d91-9e67-1e20843b61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330e0e9e-44d0-4d91-9e67-1e20843b61ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7e258c-aec0-4710-8cfe-cd86e66bfc71', 'volume_name': 'volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab2fecf-c430-4651-981e-a32ac5b630d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab2fecf-c430-4651-981e-a32ac5b630d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c581d13-c9c3-43a8-a897-baa6ea454c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume 2a7e258c-aec0-4710-8cfe-cd86e66bfc71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71', 'volume_size': 1} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51952043-e3f6-46dc-abf9-b704bf29c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162c8adf-779f-47fc-93ef-c3e394329475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 (da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223): created successfully Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162c8adf-779f-47fc-93ef-c3e394329475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (275f139f-91f4-4bf9-b62a-33d81713a960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-226f7a94-9812-4deb-a3bb-f60a34aa2e0e tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created volume successfully. Jun 12 04:58:57 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe 1073741824" returned: 0 in 0.740s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:57 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe Jun 12 04:58:57 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:58 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe" returned: 0 in 0.569s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-757329957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5998773-0250-4496-9dcf-127132eca57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34d4b76ef324455bd3d176bbb5ce79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='bd62d3096da24fe7ad0a518e8e68009b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Creating volume b5998773-0250-4496-9dcf-127132eca57d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:58 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dbedb0-451c-4b80-9220-f48bfcaff4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:58 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d 1073741824 Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e9dba8-5524-4906-b78b-8159921fbf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:58 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:58 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe (07b5dcff-d7c1-4593-8f5b-210826c6abbe): created successfully Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e9dba8-5524-4906-b78b-8159921fbf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (5363eee5-badc-40c7-af89-ee8be766a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:58 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7105f420-e396-4bea-bf1d-7bc855e8e6f3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created volume successfully. Jun 12 04:58:58 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d 1073741824" returned: 0 in 0.751s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:59 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d Jun 12 04:58:59 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:59 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.370s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256272617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c563c3fc-b29a-4f33-9d43-d4604b17a18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Creating volume c563c3fc-b29a-4f33-9d43-d4604b17a18d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:58:59 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c141eee9-262f-4a8d-901f-3861217e112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5998773-0250-4496-9dcf-127132eca57d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:59 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d 1073741824 Jun 12 04:58:59 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fc1f7b-69a1-400a-80bb-c0034d4684c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:58:59 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Volume volume-b5998773-0250-4496-9dcf-127132eca57d (b5998773-0250-4496-9dcf-127132eca57d): created successfully Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fc1f7b-69a1-400a-80bb-c0034d4684c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:58:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Flow 'volume_create_manager' (a41077a0-3322-438d-bedc-0fc66f7e3dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:58:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5413d2e1-1772-4a67-ba46-280858c618f8 tempest-VolumeQuotasAdminTestJSON-570642305 None] Created volume successfully. Jun 12 04:59:00 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d 1073741824" returned: 0 in 0.770s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:00 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d Jun 12 04:59:00 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-db77bffb-5f66-4d19-86da-8ee1bd725976 tempest-VolumeQuotasAdminTestJSON-1205549940 None] Transfer volume completed successfully. Jun 12 04:59:00 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d" returned: 0 in 0.588s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.433s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2020238299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1bacf8-cf29-4dd3-8a5e-7b44becdee25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:56Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Creating volume 4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:00 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:00 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 1073741824 Jun 12 04:59:00 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58558d7-4656-4152-978a-e4f935a4e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bd6c7b-bde9-4751-ad8f-90b9c70ac266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:01 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d (c563c3fc-b29a-4f33-9d43-d4604b17a18d): created successfully Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bd6c7b-bde9-4751-ad8f-90b9c70ac266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (90604f05-8cd4-41c0-b1fe-36bdafd2b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:01 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-08080253-5080-4f31-9a05-59de0bd88999 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created volume successfully. Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Acquiring lock "cinder-b5998773-0250-4496-9dcf-127132eca57d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Lock "cinder-b5998773-0250-4496-9dcf-127132eca57d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Acquiring lock "cinder-quobyte-b5998773-0250-4496-9dcf-127132eca57d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Lock "cinder-quobyte-b5998773-0250-4496-9dcf-127132eca57d" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadb60e6-ef1d-47fa-b75d-1b9554b1569c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:01 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d Jun 12 04:59:01 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:01 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 1073741824" returned: 0 in 0.816s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:01 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 Jun 12 04:59:01 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:02 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:02 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d Jun 12 04:59:02 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:02 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25" returned: 0 in 0.587s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.516s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-768299127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7e258c-aec0-4710-8cfe-cd86e66bfc71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a450d91d7d4f401ca1cb79e08746e4e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:58:57Z,use_quota=True,user_id='61a010a28b4749818ef35d456642151c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Creating volume 2a7e258c-aec0-4710-8cfe-cd86e66bfc71 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:02 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:02 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 1073741824 Jun 12 04:59:02 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8f7c01-c756-496e-8c41-26dc6d15fc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518c81bf-7df4-4d7d-8699-b555689c04b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 (4a1bacf8-cf29-4dd3-8a5e-7b44becdee25): created successfully Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518c81bf-7df4-4d7d-8699-b555689c04b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (abb87028-4bff-403e-92ed-0762b88aedda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-74a31805-4273-47da-be29-5148974d4f1f tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created volume successfully. Jun 12 04:59:02 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b5998773-0250-4496-9dcf-127132eca57d" returned: 0 in 0.601s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Lock "cinder-quobyte-b5998773-0250-4496-9dcf-127132eca57d" released by "delete_volume" :: held 1.368s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Created reservations ['701d7f61-2744-4460-ba27-9c0a84997780', 'de79e2d8-779e-46b8-8ca3-adda7551687d', '1d44ed46-18a4-412c-9790-c943f3868d22', 'e2e28114-a685-4d53-b7b3-39b98b186d6e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:03 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:03 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:03 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 1073741824" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:03 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 Jun 12 04:59:03 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:03 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.623s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Deleted volume successfully. Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-dbb4ac14-a615-4126-a70d-f5f93ce8e290 tempest-VolumeQuotasAdminTestJSON-1953006470 None] Lock "cinder-b5998773-0250-4496-9dcf-127132eca57d-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:03 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c581d13-c9c3-43a8-a897-baa6ea454c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39da1240-1406-49f0-a97c-ab5a59b199a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:03 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Volume volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 (2a7e258c-aec0-4710-8cfe-cd86e66bfc71): created successfully Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39da1240-1406-49f0-a97c-ab5a59b199a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Flow 'volume_create_manager' (eab85cf2-07a7-4241-92f1-11afe68fd1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-46c13270-3528-410f-8f4c-54eaccd959d3 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created volume successfully. Jun 12 04:59:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-2a7e258c-aec0-4710-8cfe-cd86e66bfc71-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-2a7e258c-aec0-4710-8cfe-cd86e66bfc71-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-quobyte-2a7e258c-aec0-4710-8cfe-cd86e66bfc71" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-2a7e258c-aec0-4710-8cfe-cd86e66bfc71" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:04 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a8a204-98e9-4f4d-8668-548890f94397]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:04 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 Jun 12 04:59:04 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:05 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:05 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71 Jun 12 04:59:05 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:05 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2a7e258c-aec0-4710-8cfe-cd86e66bfc71" returned: 0 in 0.655s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-2a7e258c-aec0-4710-8cfe-cd86e66bfc71" released by "delete_volume" :: held 1.434s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created reservations ['53ead188-e618-4590-93c0-423768a7a239', '588f414f-7621-48b2-8d64-aa14ce86b8e3', 'f553f22a-fd46-43a6-9821-d9fde656a9f4', '9a4a940d-02d7-4ada-b309-663fedb887a9'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:06 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:06 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:06 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.631s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Deleted volume successfully. Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8126cb73-7ce7-4fcf-b1f0-0e8c156a2e6a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-2a7e258c-aec0-4710-8cfe-cd86e66bfc71-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-quobyte-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11cee65-ed68-4404-a0a7-e38ebf3b9dd1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:06 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 Jun 12 04:59:06 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:07 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25" returned: 0 in 0.727s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:07 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25 Jun 12 04:59:07 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:08 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25" returned: 0 in 0.605s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25" released by "delete_volume" :: held 1.376s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created reservations ['ee112d3e-9c93-477f-910b-3949fd2e0dc1', '037af970-afc8-47d8-ba40-8da8a8fa7720', '8a6ac438-1303-4bcd-be92-82bc50f69413', '15a8a38b-31d4-4a7b-bb47-053f26ce0193'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:08 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:08 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:08 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.607s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:08 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Deleted volume successfully. Jun 12 04:59:08 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-323ed9c8-508b-40b2-a6e1-78dd454d6e18 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-4a1bacf8-cf29-4dd3-8a5e-7b44becdee25-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-c563c3fc-b29a-4f33-9d43-d4604b17a18d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-c563c3fc-b29a-4f33-9d43-d4604b17a18d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-quobyte-c563c3fc-b29a-4f33-9d43-d4604b17a18d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-c563c3fc-b29a-4f33-9d43-d4604b17a18d" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[441925d0-f7fd-403f-8b2e-48461ed4707c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:09 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d Jun 12 04:59:09 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:09 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d" returned: 0 in 0.759s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:09 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d Jun 12 04:59:09 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Flow 'volume_create_manager' (0c417c2b-b025-413b-96c2-dd6d366c2026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e840ab46-4d0e-4c70-99f4-39831e0ed7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e840ab46-4d0e-4c70-99f4-39831e0ed7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-107308539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf392c9-4421-41cb-b8a9-3a2e3d10b10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc061db450f45e5866a0961612600e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:10Z,use_quota=True,user_id='cd1171ecc4124a06bb60af553f2ad807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efefddce-4951-43a2-9381-c580a5247473),volume_type_id=efefddce-4951-43a2-9381-c580a5247473)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7b2656-f46a-4c19-b50b-ed1ac6e0874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:10 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7b2656-f46a-4c19-b50b-ed1ac6e0874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d32cdde-b90c-4d57-8836-af8892a86ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d32cdde-b90c-4d57-8836-af8892a86ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf392c9-4421-41cb-b8a9-3a2e3d10b10f', 'volume_name': 'volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281563b2-9438-4008-b329-fd63ab8e8ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281563b2-9438-4008-b329-fd63ab8e8ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abadd19f-582b-493a-965c-13b84bb95300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:10 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Volume fcf392c9-4421-41cb-b8a9-3a2e3d10b10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f', 'volume_size': 1} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-107308539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf392c9-4421-41cb-b8a9-3a2e3d10b10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc061db450f45e5866a0961612600e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:10Z,use_quota=True,user_id='cd1171ecc4124a06bb60af553f2ad807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efefddce-4951-43a2-9381-c580a5247473),volume_type_id=efefddce-4951-43a2-9381-c580a5247473)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Creating volume fcf392c9-4421-41cb-b8a9-3a2e3d10b10f {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:10 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-c563c3fc-b29a-4f33-9d43-d4604b17a18d" returned: 0 in 0.672s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:10 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f 1073741824 Jun 12 04:59:10 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-c563c3fc-b29a-4f33-9d43-d4604b17a18d" released by "delete_volume" :: held 1.485s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created reservations ['98a29d98-b279-4088-b564-f30e596a6d92', '35d9b166-7fa2-4cf9-a6fd-092dcea42dd6', '09c2e54f-d41d-4481-a8e9-bc3436c9a9fd', '0aada9d1-feb2-4436-82df-72797cfeaedb'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:10 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:10 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:11 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.598s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Deleted volume successfully. Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-07b5dcff-d7c1-4593-8f5b-210826c6abbe-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b197bcef-a7f3-4b5d-963c-ed3dfba75414 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-c563c3fc-b29a-4f33-9d43-d4604b17a18d-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:11 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-07b5dcff-d7c1-4593-8f5b-210826c6abbe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f 1073741824" returned: 0 in 0.799s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-quobyte-07b5dcff-d7c1-4593-8f5b-210826c6abbe" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-07b5dcff-d7c1-4593-8f5b-210826c6abbe" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:11 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f Jun 12 04:59:11 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ec15e6-5b48-4163-8fb2-9d101b5a0e67]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:11 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe Jun 12 04:59:11 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:11 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abadd19f-582b-493a-965c-13b84bb95300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0c7b4c-7835-4228-bfa5-cc2536c2f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Volume volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f (fcf392c9-4421-41cb-b8a9-3a2e3d10b10f): created successfully Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0c7b4c-7835-4228-bfa5-cc2536c2f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Flow 'volume_create_manager' (0c417c2b-b025-413b-96c2-dd6d366c2026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1cb09342-7a82-4142-be26-faf723a56df7 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Created volume successfully. Jun 12 04:59:12 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe" returned: 0 in 0.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:12 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe Jun 12 04:59:12 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:12 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-07b5dcff-d7c1-4593-8f5b-210826c6abbe" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-07b5dcff-d7c1-4593-8f5b-210826c6abbe" released by "delete_volume" :: held 1.405s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created reservations ['2d1dbc88-8f03-4011-9f65-6edba1f566c7', 'faf27b1a-bc27-422f-b3ba-193c6ddf06f5', '4f5b7aca-b8d2-42b6-a3de-f6274b75b2c5', '4d917cfa-d6fa-4aea-8553-74699e4f260a'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:12 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:12 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:13 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:13 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:13 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.591s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:13 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Deleted volume successfully. Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-289cd761-998f-47a5-a690-2563cc20dfed tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-07b5dcff-d7c1-4593-8f5b-210826c6abbe-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:13 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.606s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:13 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-bab1182e-14ae-43f7-b05b-1a246ca8e5c4 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Retype volume completed successfully. Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-quobyte-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a85c5-2bf5-4e40-af44-cfd730783980]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:13 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 Jun 12 04:59:13 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Acquiring lock "cinder-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "cinder-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Acquiring lock "cinder-quobyte-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "cinder-quobyte-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3286fb68-a3d6-4716-ad0a-94473bc8b1f9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:14 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f Jun 12 04:59:14 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:14 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223" returned: 0 in 0.707s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:14 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223 Jun 12 04:59:14 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:14 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:14 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f" returned: 0 in 0.740s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223" returned: 0 in 0.630s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:15 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223" released by "delete_volume" :: held 1.383s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:15 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created reservations ['d8cbdcfd-7ef0-4872-a02b-131552641aac', '8d63b237-9a4f-444b-b0b2-71d0549caca5', 'ae5b3862-ffa5-4172-9098-c4031a155a77', 'e4a3aac9-a336-4ff8-ad4d-9a529fb22738'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:15 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:15 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:15 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f" returned: 0 in 0.616s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "cinder-quobyte-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f" released by "delete_volume" :: held 1.403s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:15 devstack cinder-volume[92320]: WARNING cinder.quota [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:59:15 devstack cinder-volume[92320]: WARNING cinder.quota [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Created reservations ['c0cfbf22-bfea-4484-bead-6147d842a764', '6bbe9f24-4319-46c4-ad2a-87f7c7212d90', 'fcdf6d1b-d4f2-4f60-9642-aa5cb10de79c', '2fe173a2-66a0-46f6-9fd8-d5ed83026ec5'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:15 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.608s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:15 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:15 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Deleted volume successfully. Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-23a1ee5b-76cd-41f2-b59e-2ce3347295e5 tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-da9e8b7b-bf33-4dc5-b2e4-3cd2feae5223-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-fd34b64b-00cd-4401-8c86-4be18e505f4c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-fd34b64b-00cd-4401-8c86-4be18e505f4c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "cinder-quobyte-fd34b64b-00cd-4401-8c86-4be18e505f4c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-fd34b64b-00cd-4401-8c86-4be18e505f4c" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2868945b-50df-49a7-8c2f-3562f3de7259]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:16 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c Jun 12 04:59:16 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:16 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.590s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:16 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Deleted volume successfully. Jun 12 04:59:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3088dabc-15a7-4dcd-a350-dc27564b7981 tempest-VolumeRetypeWithoutMigrationTest-377901774 None] Lock "cinder-fcf392c9-4421-41cb-b8a9-3a2e3d10b10f-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:16 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c" returned: 0 in 0.723s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:16 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c Jun 12 04:59:16 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:17 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fd34b64b-00cd-4401-8c86-4be18e505f4c" returned: 0 in 0.594s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-quobyte-fd34b64b-00cd-4401-8c86-4be18e505f4c" released by "delete_volume" :: held 1.364s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Created reservations ['78eafd3a-3103-4162-86fb-5e99e3564f3e', '3dca44a7-027f-40e9-93a9-a3eb1a05bbcb', 'b68178c0-edf1-4677-8369-342942a93cb6', '778716db-47fa-41be-9ea8-5e45636ba46a'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:17 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:17 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:17 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.613s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:17 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Deleted volume successfully. Jun 12 04:59:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-70369bbf-63bd-443f-a8c7-b4046946a56a tempest-CreateVolumesFromSourceVolumeTest-329818327 None] Lock "cinder-fd34b64b-00cd-4401-8c86-4be18e505f4c-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Flow 'volume_create_manager' (85097754-261d-4366-b0f3-aa9300d947a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3628a89b-c7cd-4431-9b19-663ddb89164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3628a89b-c7cd-4431-9b19-663ddb89164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-588365218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6041530-0b70-4fbe-8416-ae90d3791ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d91523b503d47b7a8ec19752e0f58ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:20Z,use_quota=True,user_id='82bdf67478b843699c0258b62bc0761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f756ab00-d84a-4daa-964f-9668a9d75ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f756ab00-d84a-4daa-964f-9668a9d75ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e772e4d3-e9c2-498b-8fa5-4fd743d07459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e772e4d3-e9c2-498b-8fa5-4fd743d07459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6041530-0b70-4fbe-8416-ae90d3791ca4', 'volume_name': 'volume-b6041530-0b70-4fbe-8416-ae90d3791ca4', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9186d7-00e3-4906-b366-e05144cd7b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9186d7-00e3-4906-b366-e05144cd7b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862a4d47-d0d4-40fe-9657-5a300fbb256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:20 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Volume b6041530-0b70-4fbe-8416-ae90d3791ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6041530-0b70-4fbe-8416-ae90d3791ca4', 'volume_size': 1} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-588365218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6041530-0b70-4fbe-8416-ae90d3791ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d91523b503d47b7a8ec19752e0f58ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:20Z,use_quota=True,user_id='82bdf67478b843699c0258b62bc0761f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Creating volume b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:20 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:20 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 1073741824 Jun 12 04:59:20 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Flow 'volume_create_manager' (cd870c11-89c3-40f3-bfc7-022111a696c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:20 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a034bec2-3541-4974-9e06-9b06c9858d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a034bec2-3541-4974-9e06-9b06c9858d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c050403d1af498e85e7ee51a42f4cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:21Z,use_quota=True,user_id='543887e23f954f58a7cc98cac2b70598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c661cb2a-55f5-41f0-9f4d-c3d21027945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c661cb2a-55f5-41f0-9f4d-c3d21027945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f06cfe0-8fa5-407f-a391-2c296fb51c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f06cfe0-8fa5-407f-a391-2c296fb51c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9', 'volume_name': 'volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91bf4bb-b30f-47a5-a9d3-e0f1d362bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91bf4bb-b30f-47a5-a9d3-e0f1d362bd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff2d809-6d61-4237-90ee-12a06c6cdadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Volume b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9', 'volume_size': 1} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:21 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 1073741824" returned: 0 in 0.749s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:21 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 Jun 12 04:59:21 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:21 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4" returned: 0 in 0.567s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c050403d1af498e85e7ee51a42f4cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:21Z,use_quota=True,user_id='543887e23f954f58a7cc98cac2b70598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Creating volume b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:21 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:21 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 1073741824 Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862a4d47-d0d4-40fe-9657-5a300fbb256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6041530-0b70-4fbe-8416-ae90d3791ca4', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:21 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e04a56c-1532-4075-a5bd-ce978046cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:22 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Volume volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 (b6041530-0b70-4fbe-8416-ae90d3791ca4): created successfully Jun 12 04:59:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e04a56c-1532-4075-a5bd-ce978046cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Flow 'volume_create_manager' (85097754-261d-4366-b0f3-aa9300d947a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-50e8555a-53f5-43f5-8d44-6dea2e7e68dc tempest-SnapshotMetadataTestJSON-1005931234 None] Created volume successfully. Jun 12 04:59:22 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 1073741824" returned: 0 in 0.756s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:22 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 Jun 12 04:59:22 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:23 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9" returned: 0 in 0.600s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.524s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Creating offline snapshot d6e31828-0440-4546-8d25-0fde6020a0ad of volume b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff2d809-6d61-4237-90ee-12a06c6cdadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31431422-2459-494f-9fd1-5c31b6e4c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c9b00-f8e5-44e1-b5c0-1af63c0763aa]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Volume volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 (b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9): created successfully Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31431422-2459-494f-9fd1-5c31b6e4c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Flow 'volume_create_manager' (cd870c11-89c3-40f3-bfc7-022111a696c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cbfe77e3-d1fc-4dbf-b889-811fca3989d3 tempest-CinderUnicodeTest-401850251 None] Created volume successfully. Jun 12 04:59:23 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 Jun 12 04:59:23 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:24 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4" returned: 0 in 0.712s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:24 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad 1G Jun 12 04:59:24 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Flow 'volume_create_manager' (66dcb9df-7c03-406e-8fa3-5b6ad7044047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7929e2-88d5-40d5-a6c8-5a11da36062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7929e2-88d5-40d5-a6c8-5a11da36062a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-314775146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70475c5e-0a10-4ef0-ba63-3d2a6ee70233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c050403d1af498e85e7ee51a42f4cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:25Z,use_quota=True,user_id='543887e23f954f58a7cc98cac2b70598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41ba182-ecce-426d-864c-a05a22a05d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41ba182-ecce-426d-864c-a05a22a05d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e0945b-d911-4c88-91dd-f51c22bb26a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e0945b-d911-4c88-91dd-f51c22bb26a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70475c5e-0a10-4ef0-ba63-3d2a6ee70233', 'volume_name': 'volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae492a7-0773-4958-b63a-23b6057bdd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae492a7-0773-4958-b63a-23b6057bdd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02787df-0992-4bf5-bd87-54ce7e46f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:24 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Volume 70475c5e-0a10-4ef0-ba63-3d2a6ee70233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233', 'volume_size': 1} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:24 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad 1G" returned: 0 in 0.710s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:24 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad Jun 12 04:59:24 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:25 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad" returned: 0 in 0.615s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:25 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad is being set with open permissions: ugo+rw Jun 12 04:59:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:25 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad Jun 12 04:59:25 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:26 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad" returned: 0 in 0.586s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:26 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info Jun 12 04:59:26 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:26 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info" returned: 0 in 0.601s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:26 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info is being set with open permissions: ugo+rw Jun 12 04:59:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:26 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info Jun 12 04:59:26 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:27 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.info" returned: 0 in 0.572s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.881s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.608s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-314775146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70475c5e-0a10-4ef0-ba63-3d2a6ee70233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c050403d1af498e85e7ee51a42f4cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:25Z,use_quota=True,user_id='543887e23f954f58a7cc98cac2b70598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Creating volume 70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:27 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:27 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 1073741824 Jun 12 04:59:27 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-14042ddc-88b7-45e8-a7d6-24085856a2cc tempest-SnapshotMetadataTestJSON-1005931234 None] Create snapshot completed successfully Jun 12 04:59:28 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 1073741824" returned: 0 in 0.764s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:28 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 Jun 12 04:59:28 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:28 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "cinder-d6e31828-0440-4546-8d25-0fde6020a0ad-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02787df-0992-4bf5-bd87-54ce7e46f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ff86ab-5a5f-43ea-bba5-4864353074bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-d6e31828-0440-4546-8d25-0fde6020a0ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "cinder-quobyte-b6041530-0b70-4fbe-8416-ae90d3791ca4" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:28 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Volume volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 (70475c5e-0a10-4ef0-ba63-3d2a6ee70233): created successfully Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ff86ab-5a5f-43ea-bba5-4864353074bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Flow 'volume_create_manager' (66dcb9df-7c03-406e-8fa3-5b6ad7044047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-quobyte-b6041530-0b70-4fbe-8416-ae90d3791ca4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "cinder-quobyte-d6e31828-0440-4546-8d25-0fde6020a0ad" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fa3a8023-42de-4a74-b74e-afe891e41554 tempest-CinderUnicodeTest-401850251 None] Created volume successfully. Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-quobyte-d6e31828-0440-4546-8d25-0fde6020a0ad" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Deleting offline snapshot d6e31828-0440-4546-8d25-0fde6020a0ad of volume b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] snapshot_file for this snap is: volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c01480-ffaa-4de0-97b1-51812e665674]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:28 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad Jun 12 04:59:28 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:29 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad" returned: 0 in 0.690s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6041530-0b70-4fbe-8416-ae90d3791ca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:59:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[50654862-1ed5-4543-9557-ae2899998a60]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:29 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 Jun 12 04:59:29 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Creating offline snapshot 76d8d152-8d23-4585-9d34-c04107348021 of volume 70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6426eac8-4a5e-43cf-8572-fdea8a26a8ae]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:30 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 Jun 12 04:59:30 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:30 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4" returned: 0 in 0.765s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:30 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad Jun 12 04:59:30 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:30 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" returned: 0 in 0.702s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:30 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 1G Jun 12 04:59:30 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:30 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad" returned: 0 in 0.683s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:31 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad Jun 12 04:59:31 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:31 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 1G" returned: 0 in 0.731s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:31 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 Jun 12 04:59:31 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:31 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4.d6e31828-0440-4546-8d25-0fde6020a0ad" returned: 0 in 0.646s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-quobyte-d6e31828-0440-4546-8d25-0fde6020a0ad" released by "_delete_snapshot" :: held 2.890s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-quobyte-b6041530-0b70-4fbe-8416-ae90d3791ca4" released by "delete_snapshot" :: held 2.915s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Created reservations ['267e0cb5-05df-440f-8887-9e29cb325b6a', '18d792cb-b5ea-4b2a-9f89-55cbc6f7ab21', 'ef2fc6a1-c703-4b67-b7c7-b962fb48d77e', 'edcbae8e-0533-455d-a6d2-f082e729193c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:31 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:31 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Delete snapshot completed successfully. Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-37cf8a44-ca3f-414f-a613-cbbc22ce4f51 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-d6e31828-0440-4546-8d25-0fde6020a0ad-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "cinder-b6041530-0b70-4fbe-8416-ae90d3791ca4-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-b6041530-0b70-4fbe-8416-ae90d3791ca4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "cinder-quobyte-b6041530-0b70-4fbe-8416-ae90d3791ca4" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-quobyte-b6041530-0b70-4fbe-8416-ae90d3791ca4" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfad6d79-9ba2-483a-91a9-2bea99716342]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:32 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 Jun 12 04:59:32 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:32 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021" returned: 0 in 0.662s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:32 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 is being set with open permissions: ugo+rw Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:32 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 Jun 12 04:59:32 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:32 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 04:59:32 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:32 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4" returned: 0 in 0.717s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=191,cinder:SELECT=137,cinder:DELETE=11,cinder:INSERT=52 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=132,cinder:INSERT=43,cinder:UPDATE=181,cinder:DELETE=19 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 04:59:32 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4 Jun 12 04:59:32 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:32 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info Jun 12 04:59:32 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:33 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b6041530-0b70-4fbe-8416-ae90d3791ca4" returned: 0 in 0.590s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-quobyte-b6041530-0b70-4fbe-8416-ae90d3791ca4" released by "delete_volume" :: held 1.376s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:33 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info" returned: 0 in 0.598s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:33 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info is being set with open permissions: ugo+rw Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Created reservations ['2ba31177-58f1-4f6f-ac25-6699f09aa828', '038dfbbc-eb7f-486a-a684-14a72c257cf0', '5f78694a-0639-40be-aa0d-cfe4fb70150c', '8a0c8f31-85c7-44be-9a6b-8ccf37e40679'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:33 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info Jun 12 04:59:33 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:33 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:33 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:34 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.info" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.973s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4bd83835-2d5c-4191-a77d-b0d4fafe64e6 tempest-CinderUnicodeTest-401850251 None] Create snapshot completed successfully Jun 12 04:59:34 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.596s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Deleted volume successfully. Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a3accbe9-d8a4-482e-9bc2-630bba274063 tempest-SnapshotMetadataTestJSON-1005931234 None] Lock "cinder-b6041530-0b70-4fbe-8416-ae90d3791ca4-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-76d8d152-8d23-4585-9d34-c04107348021-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Lock "cinder-76d8d152-8d23-4585-9d34-c04107348021-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-quobyte-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-quobyte-76d8d152-8d23-4585-9d34-c04107348021" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-76d8d152-8d23-4585-9d34-c04107348021" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Deleting offline snapshot 76d8d152-8d23-4585-9d34-c04107348021 of volume 70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] snapshot_file for this snap is: volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c84aa41-1cd8-445e-bea1-093f946ee495]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:34 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 Jun 12 04:59:34 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:35 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021" returned: 0 in 0.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:59:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b671420e-b10c-4d0f-95f0-de891ba402e1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:35 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 Jun 12 04:59:35 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:35 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" returned: 0 in 0.774s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:36 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 Jun 12 04:59:36 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:36 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021" returned: 0 in 0.712s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:36 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021 Jun 12 04:59:36 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Flow 'volume_create_manager' (b13b9f55-1572-462e-9c90-51cca2e3db42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15373608-f3ed-4bc7-abdb-0df28022381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15373608-f3ed-4bc7-abdb-0df28022381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219745545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a30c7f-6800-4e66-89d0-ceb0496f5e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58494c0ebf914195b9c050815edb7329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:37Z,use_quota=True,user_id='3426c3c49d184b7bbf8650a6c2f7a792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d423042b-c906-4033-9cde-f6f8be474506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d423042b-c906-4033-9cde-f6f8be474506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6671bd2b-5693-43c1-9d20-0f7148be0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6671bd2b-5693-43c1-9d20-0f7148be0139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a30c7f-6800-4e66-89d0-ceb0496f5e39', 'volume_name': 'volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe264139-5cfa-432b-92e2-419b6e0decc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe264139-5cfa-432b-92e2-419b6e0decc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f221d7ee-337b-4253-a325-23395024c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:37 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Volume 13a30c7f-6800-4e66-89d0-ceb0496f5e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39', 'volume_size': 1} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219745545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a30c7f-6800-4e66-89d0-ceb0496f5e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58494c0ebf914195b9c050815edb7329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:37Z,use_quota=True,user_id='3426c3c49d184b7bbf8650a6c2f7a792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Creating volume 13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:37 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:37 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 1073741824 Jun 12 04:59:37 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:37 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233.76d8d152-8d23-4585-9d34-c04107348021" returned: 0 in 0.615s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-76d8d152-8d23-4585-9d34-c04107348021" released by "_delete_snapshot" :: held 2.979s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" released by "delete_snapshot" :: held 3.003s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Created reservations ['ee9b29a6-f567-4357-8564-a0077562d4f0', '40daa56b-c7bd-49aa-9d83-7a0e350ef520', 'b0c11cd4-2830-485d-b06d-613e52c3d44c', '5c7fa1cb-ed25-460f-9851-806fb9e9737b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Delete snapshot completed successfully. Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0dec8093-a674-45f3-a8e3-692e5ed93a6d tempest-CinderUnicodeTest-401850251 None] Lock "cinder-76d8d152-8d23-4585-9d34-c04107348021-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-70475c5e-0a10-4ef0-ba63-3d2a6ee70233-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-70475c5e-0a10-4ef0-ba63-3d2a6ee70233-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-quobyte-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37ed0d-b484-4e1c-925d-4b68345283e9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:37 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 Jun 12 04:59:37 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:37 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 1073741824" returned: 0 in 0.788s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:37 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 Jun 12 04:59:37 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:38 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" returned: 0 in 0.743s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:38 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233 Jun 12 04:59:38 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:38 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39" returned: 0 in 0.592s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f221d7ee-337b-4253-a325-23395024c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c3617c-e58f-483e-9b2a-7a6696fb6420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Volume volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 (13a30c7f-6800-4e66-89d0-ceb0496f5e39): created successfully Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c3617c-e58f-483e-9b2a-7a6696fb6420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Flow 'volume_create_manager' (b13b9f55-1572-462e-9c90-51cca2e3db42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7870cfa4-d1d2-4a77-971c-282c9b4b28b7 tempest-VolumesDeleteCascade-499924855 None] Created volume successfully. Jun 12 04:59:39 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" returned: 0 in 0.603s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-70475c5e-0a10-4ef0-ba63-3d2a6ee70233" released by "delete_volume" :: held 1.400s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Created reservations ['cccc5f4d-eacd-4a35-a85c-ca4af1710c14', '6fc994c9-ccd6-4f25-a124-a6d9f45b723d', '0195af71-aa0c-481e-a0b4-d50d8b75b49a', '1e95f8e3-326a-474b-9915-4a1af34995d2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:39 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:39 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Creating offline snapshot a4a24ab4-6695-406e-aa70-89c4047bf05e of volume 13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d94c6c-821d-4ff9-8b6c-5728436c3a16]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:39 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 Jun 12 04:59:39 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:39 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Deleted volume successfully. Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-68b39e27-bb55-4edb-9abc-3cfda585ff77 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-70475c5e-0a10-4ef0-ba63-3d2a6ee70233-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "cinder-quobyte-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d372ad3-ddf4-4776-96c7-162aab1db675]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:40 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 Jun 12 04:59:40 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:40 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39" returned: 0 in 0.731s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:40 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e 1G Jun 12 04:59:40 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:40 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9" returned: 0 in 0.720s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:40 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9 Jun 12 04:59:40 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:40 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e 1G" returned: 0 in 0.788s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:40 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:40 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:41 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9" returned: 0 in 0.623s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-quobyte-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9" released by "delete_volume" :: held 1.389s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Created reservations ['bf81dae0-d4ed-47fa-8bb6-af40c459b887', '72a67d1d-1c96-4b0c-a408-7647cff15813', 'f155416e-6f84-4468-ba40-8dc7381a648b', '650ac984-320e-485a-b85b-7ea350c69fcf'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:41 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:41 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:41 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.631s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:41 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e is being set with open permissions: ugo+rw Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:41 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:41 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:41 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.622s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:41 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:42 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Deleted volume successfully. Jun 12 04:59:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e972a6a9-1992-49fe-9623-826a932c2085 tempest-CinderUnicodeTest-401850251 None] Lock "cinder-b8e33f7a-a9f0-4407-b6d7-13ed091c1cf9-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:42 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.604s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:42 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info Jun 12 04:59:42 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:42 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info" returned: 0 in 0.627s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:42 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info is being set with open permissions: ugo+rw Jun 12 04:59:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:42 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info Jun 12 04:59:42 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:43 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.info" returned: 0 in 0.604s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cf8e50fe-c118-436d-857f-12ceb1c22e4f tempest-VolumesDeleteCascade-499924855 None] Create snapshot completed successfully Jun 12 04:59:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Creating offline snapshot 9c01cb8c-5435-48ba-a328-539ff94d7ee0 of volume 13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:59:44 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04bfde4-2415-4025-984e-0922648340f1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:44 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:44 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:45 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.789s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:59:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:45 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 1G Jun 12 04:59:45 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:46 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 1G" returned: 0 in 0.839s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:46 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 Jun 12 04:59:46 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:47 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0" returned: 0 in 0.647s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:47 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 is being set with open permissions: ugo+rw Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:47 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 Jun 12 04:59:47 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:47 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0" returned: 0 in 0.626s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:47 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-aa420b2a-746d-4975-89de-9712c026eaf2 tempest-VolumesDeleteCascade-499924855 None] Create snapshot completed successfully Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-13a30c7f-6800-4e66-89d0-ceb0496f5e39-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-13a30c7f-6800-4e66-89d0-ceb0496f5e39-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Performing cascade delete. {{(pid=92320) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 12 04:59:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-9c01cb8c-5435-48ba-a328-539ff94d7ee0-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-9c01cb8c-5435-48ba-a328-539ff94d7ee0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-9c01cb8c-5435-48ba-a328-539ff94d7ee0" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-9c01cb8c-5435-48ba-a328-539ff94d7ee0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Deleting offline snapshot 9c01cb8c-5435-48ba-a328-539ff94d7ee0 of volume 13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] snapshot_file for this snap is: volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a62dc9-2348-4e36-835c-58a4dffaa8ae]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:48 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 Jun 12 04:59:48 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:48 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0" returned: 0 in 0.843s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60f099-e388-456f-a1c3-86a538f08305]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:49 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:49 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:49 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.764s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:59:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:49 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 Jun 12 04:59:49 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:50 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0" returned: 0 in 0.809s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:50 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0 Jun 12 04:59:50 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:51 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.9c01cb8c-5435-48ba-a328-539ff94d7ee0" returned: 0 in 0.612s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-9c01cb8c-5435-48ba-a328-539ff94d7ee0" released by "_delete_snapshot" :: held 3.129s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" released by "delete_snapshot" :: held 3.152s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Created reservations ['63a055e3-3384-42d6-b518-28b7ac6a06c2', '161b3202-e0c2-4813-81f9-dccd1ca8c914', 'dd335ff0-ed51-4360-8f0a-56e2ad5e7daf', '7bb60943-92ec-4b95-b936-77558490aa0f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:51 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Delete snapshot completed successfully. Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-9c01cb8c-5435-48ba-a328-539ff94d7ee0-delete_snapshot" released by "delete_snapshot" :: held 3.292s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-a4a24ab4-6695-406e-aa70-89c4047bf05e-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-a4a24ab4-6695-406e-aa70-89c4047bf05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-a4a24ab4-6695-406e-aa70-89c4047bf05e" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-a4a24ab4-6695-406e-aa70-89c4047bf05e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Deleting offline snapshot a4a24ab4-6695-406e-aa70-89c4047bf05e of volume 13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] snapshot_file for this snap is: volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ba4f04-3612-4ce7-a568-051f864b544c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:51 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:51 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:52 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 04:59:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28f5797-fceb-4a65-a3b5-a93cdfc22b59]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:52 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 Jun 12 04:59:52 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:52 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39" returned: 0 in 0.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:53 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:53 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:53 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.761s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:53 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e Jun 12 04:59:53 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:54 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39.a4a24ab4-6695-406e-aa70-89c4047bf05e" returned: 0 in 0.659s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-a4a24ab4-6695-406e-aa70-89c4047bf05e" released by "_delete_snapshot" :: held 3.097s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" released by "delete_snapshot" :: held 3.122s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Created reservations ['83df8c54-1f60-4988-a604-b731d178efe6', '438e816d-1acb-48ef-b9a6-43e25af6583b', '530c68ea-81ed-407b-a412-cd1e39093103', '9742c5cc-45bb-4256-8bf6-dd96df951ea0'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:54 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Delete snapshot completed successfully. Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-a4a24ab4-6695-406e-aa70-89c4047bf05e-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Snapshots deleted, issuing volume delete {{(pid=92320) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[696da397-2c22-4af4-9c98-e771647f8d00]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:54 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 Jun 12 04:59:54 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:55 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39" returned: 0 in 0.709s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:55 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39 Jun 12 04:59:55 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:55 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-13a30c7f-6800-4e66-89d0-ceb0496f5e39" returned: 0 in 0.612s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-13a30c7f-6800-4e66-89d0-ceb0496f5e39" released by "delete_volume" :: held 1.382s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Created reservations ['8d9f2406-6fe7-4553-9b0a-239be9ac02bb', 'cecb8416-6495-4ab8-91d0-c79dc36fffcc', '2725872e-8d1c-4065-947b-0902c9d796cb', 'bbfe49be-8a8c-48dc-b0c5-dead1a7733dc'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:56 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 04:59:56 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:56 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 04:59:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Deleted volume successfully. Jun 12 04:59:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-940c3003-12ee-4582-9108-7abae952c070 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-13a30c7f-6800-4e66-89d0-ceb0496f5e39-delete_volume" released by "delete_volume" :: held 8.934s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Flow 'volume_create_manager' (2f47fa57-3753-45f8-a14e-ce50693df617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a0dc5d-7c60-4f15-b0bb-c9d3fd8ceab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a0dc5d-7c60-4f15-b0bb-c9d3fd8ceab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-331132930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe1ee60-c655-48a3-a41d-a9fe6eb1a264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58494c0ebf914195b9c050815edb7329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:57Z,use_quota=True,user_id='3426c3c49d184b7bbf8650a6c2f7a792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6040601c-dd67-4736-ac66-db6b54aeafa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6040601c-dd67-4736-ac66-db6b54aeafa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211568c5-e843-4be6-8c77-3107fafebb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211568c5-e843-4be6-8c77-3107fafebb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe1ee60-c655-48a3-a41d-a9fe6eb1a264', 'volume_name': 'volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5d5e6b-fa0d-4cfc-bd2d-38c48e76fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5d5e6b-fa0d-4cfc-bd2d-38c48e76fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297f6a53-8a56-4736-a954-2878099735b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:57 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Volume 5fe1ee60-c655-48a3-a41d-a9fe6eb1a264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264', 'volume_size': 1} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T02:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-331132930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe1ee60-c655-48a3-a41d-a9fe6eb1a264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58494c0ebf914195b9c050815edb7329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T02:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T02:59:57Z,use_quota=True,user_id='3426c3c49d184b7bbf8650a6c2f7a792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Creating volume 5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 04:59:57 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 04:59:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:57 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 1073741824 Jun 12 04:59:57 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:58 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 1073741824" returned: 0 in 0.946s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:58 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 04:59:58 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 04:59:58 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.664s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297f6a53-8a56-4736-a954-2878099735b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13ba986-1736-4201-8a87-fb0695e43b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 04:59:59 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Volume volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 (5fe1ee60-c655-48a3-a41d-a9fe6eb1a264): created successfully Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13ba986-1736-4201-8a87-fb0695e43b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Flow 'volume_create_manager' (2f47fa57-3753-45f8-a14e-ce50693df617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 04:59:59 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-59da41f9-becb-43e0-9ae9-4d08f43a3647 tempest-VolumesDeleteCascade-499924855 None] Created volume successfully. Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Creating offline snapshot 9de13688-e7de-4c84-9f44-f1d190db6e38 of volume 5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[090012be-9215-4685-bd4c-97608ba0a44b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 04:59:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 04:59:59 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 04:59:59 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:00 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:00 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 1G Jun 12 05:00:00 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:01 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 1G" returned: 0 in 0.871s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:01 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 Jun 12 05:00:01 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:01 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38" returned: 0 in 0.655s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:01 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 is being set with open permissions: ugo+rw Jun 12 05:00:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:01 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 Jun 12 05:00:01 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Flow 'volume_create_manager' (bb429e7d-5fee-4ad1-90e4-63eb85747cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e6e504-2a08-4957-9e79-47dce7711e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e6e504-2a08-4957-9e79-47dce7711e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1358591774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac4a971-2b95-41f4-b111-b139c552a126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ed46c9d07d4654987d73727921332d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:02Z,use_quota=True,user_id='bc27010320514072a1f774bc9cf73254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23070308-df0e-41e6-baa0-682ac9b927dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23070308-df0e-41e6-baa0-682ac9b927dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e70449-391c-47ea-af10-91d9ccd2f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e70449-391c-47ea-af10-91d9ccd2f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac4a971-2b95-41f4-b111-b139c552a126', 'volume_name': 'volume-4ac4a971-2b95-41f4-b111-b139c552a126', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1524334f-8df9-4c14-8112-7515fde17ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1524334f-8df9-4c14-8112-7515fde17ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a475bf-48d8-44df-9b85-043d1b16f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Volume 4ac4a971-2b95-41f4-b111-b139c552a126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac4a971-2b95-41f4-b111-b139c552a126', 'volume_size': 1} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:02 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38" returned: 0 in 0.573s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:02 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info Jun 12 05:00:02 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:03 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info" returned: 0 in 0.614s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:03 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info is being set with open permissions: ugo+rw Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:03 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info Jun 12 05:00:03 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:03 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.info" returned: 0 in 0.588s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.122s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1358591774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac4a971-2b95-41f4-b111-b139c552a126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ed46c9d07d4654987d73727921332d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:02Z,use_quota=True,user_id='bc27010320514072a1f774bc9cf73254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Creating volume 4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:03 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:00:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:03 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 1073741824 Jun 12 05:00:03 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ea5452ba-4336-437d-8a6d-c04ce69a5d66 tempest-VolumesDeleteCascade-499924855 None] Create snapshot completed successfully Jun 12 05:00:04 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 1073741824" returned: 0 in 0.765s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:04 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:04 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:05 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.615s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a475bf-48d8-44df-9b85-043d1b16f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac4a971-2b95-41f4-b111-b139c552a126', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa849aef-4264-42dd-a572-25081e5a19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Volume volume-4ac4a971-2b95-41f4-b111-b139c552a126 (4ac4a971-2b95-41f4-b111-b139c552a126): created successfully Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa849aef-4264-42dd-a572-25081e5a19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Flow 'volume_create_manager' (bb429e7d-5fee-4ad1-90e4-63eb85747cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:05 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0072af58-abca-4b0b-a6be-7639028632f5 tempest-SnapshotDependencyTests-1615298877 None] Created volume successfully. Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Flow 'volume_create_manager' (9d8ee9ff-013b-4abf-a4bd-29d20e21a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566972a8-2210-40fc-a668-d8d9e441a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566972a8-2210-40fc-a668-d8d9e441a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-23364485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ffbd01-2eba-44ec-a7fa-fa48dc78415e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58494c0ebf914195b9c050815edb7329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9de13688-e7de-4c84-9f44-f1d190db6e38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:05Z,use_quota=True,user_id='3426c3c49d184b7bbf8650a6c2f7a792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45f9a1a-a945-4fc4-9050-a9ba7eb60fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45f9a1a-a945-4fc4-9050-a9ba7eb60fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbb3fc3-60a5-41b5-9596-84e2a3528078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbb3fc3-60a5-41b5-9596-84e2a3528078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15ffbd01-2eba-44ec-a7fa-fa48dc78415e', 'volume_name': 'volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e', 'volume_size': 1, 'snapshot_id': '9de13688-e7de-4c84-9f44-f1d190db6e38'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5703185-bd77-45fb-a4b3-0a5ea5ea05c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5703185-bd77-45fb-a4b3-0a5ea5ea05c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133f084-1123-4826-b8ac-5f9827472cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Volume 15ffbd01-2eba-44ec-a7fa-fa48dc78415e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e', 'volume_size': 1, 'snapshot_id': '9de13688-e7de-4c84-9f44-f1d190db6e38'} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-9de13688-e7de-4c84-9f44-f1d190db6e38-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-9de13688-e7de-4c84-9f44-f1d190db6e38-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Creating volume 15ffbd01-2eba-44ec-a7fa-fa48dc78415e from snapshot 9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] snapshot: 9de13688-e7de-4c84-9f44-f1d190db6e38, volume: 15ffbd01-2eba-44ec-a7fa-fa48dc78415e, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b9aacf-4b2d-4e62-8402-e22b7faf39aa]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:05 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 Jun 12 05:00:05 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:06 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38" returned: 0 in 0.726s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94d06ad-c9a1-45a3-89e3-4d5b09658b74]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:06 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 05:00:06 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:06 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.722s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:00:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:06 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e Jun 12 05:00:06 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:11 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" returned: 0 in 4.301s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d92af40-f9df-4d39-b7c0-6797c77c056a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:11 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 05:00:11 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:12 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.817s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:00:12 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Converted 1024.00 MB image at 238.02 MB/s Jun 12 05:00:12 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e is being set with open permissions: ugo+rw Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:12 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e Jun 12 05:00:12 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:12 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" returned: 0 in 0.600s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" released by "_copy_volume_from_snapshot" :: held 7.274s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-9de13688-e7de-4c84-9f44-f1d190db6e38-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" released by "_create_volume_from_snapshot" :: held 7.306s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.323s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.117s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Creating offline snapshot 70c7134d-ef93-4b7c-b602-8f248d9e05a4 of volume 4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44d042f-36aa-46af-b32c-e353d18f6a59]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133f084-1123-4826-b8ac-5f9827472cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e', 'volume_size': 1, 'snapshot_id': '9de13688-e7de-4c84-9f44-f1d190db6e38'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f8f05-60cc-4833-9fa8-490aed459372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Volume volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e (15ffbd01-2eba-44ec-a7fa-fa48dc78415e): created successfully Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f8f05-60cc-4833-9fa8-490aed459372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Flow 'volume_create_manager' (9d8ee9ff-013b-4abf-a4bd-29d20e21a551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-204bc2f8-5491-4c02-ab55-1cb473d55162 tempest-VolumesDeleteCascade-499924855 None] Created volume successfully. Jun 12 05:00:12 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:12 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Performing cascade delete. {{(pid=92320) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-9de13688-e7de-4c84-9f44-f1d190db6e38-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-9de13688-e7de-4c84-9f44-f1d190db6e38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-9de13688-e7de-4c84-9f44-f1d190db6e38" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-9de13688-e7de-4c84-9f44-f1d190db6e38" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Deleting offline snapshot 9de13688-e7de-4c84-9f44-f1d190db6e38 of volume 5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] snapshot_file for this snap is: volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b86f6-d6f0-4582-b255-eb81e8c7566d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:13 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 Jun 12 05:00:13 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:13 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.725s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:13 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 1G Jun 12 05:00:13 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:13 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38" returned: 0 in 0.716s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[28166db3-f450-4432-a20c-a33252169593]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:13 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 05:00:13 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:14 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 1G" returned: 0 in 0.734s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac4a971-2b95-41f4-b111-b139c552a126 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:14 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac4a971-2b95-41f4-b111-b139c552a126 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 Jun 12 05:00:14 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:14 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.699s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:14 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 Jun 12 05:00:14 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:14 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac4a971-2b95-41f4-b111-b139c552a126 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4" returned: 0 in 0.616s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:14 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 is being set with open permissions: ugo+rw Jun 12 05:00:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:14 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 Jun 12 05:00:14 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:15 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38" returned: 0 in 0.682s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:15 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38 Jun 12 05:00:15 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:15 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:15 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info Jun 12 05:00:15 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:15 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264.9de13688-e7de-4c84-9f44-f1d190db6e38" returned: 0 in 0.600s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-9de13688-e7de-4c84-9f44-f1d190db6e38" released by "_delete_snapshot" :: held 2.795s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" released by "delete_snapshot" :: held 2.816s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Created reservations ['305d2f73-c923-401d-9cc3-aed6c96a3488', 'f6528248-f4bf-4c39-b1b2-5f1099c59fc8', 'c53770c3-993b-478a-a5df-75bc7d6dbe49', '13d8ec8b-9957-42af-b051-7bdfd51fd1cc'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Delete snapshot completed successfully. Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-9de13688-e7de-4c84-9f44-f1d190db6e38-delete_snapshot" released by "delete_snapshot" :: held 2.963s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Snapshots deleted, issuing volume delete {{(pid=92320) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 12 05:00:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" acquired by "delete_volume" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:16 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info" returned: 0 in 0.641s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:16 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info is being set with open permissions: ugo+rw Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bae969-7892-48be-bef0-b89e7026fe7a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:16 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info Jun 12 05:00:16 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:16 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 05:00:16 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:16 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.info" returned: 0 in 0.582s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3c8c3b72-9ec7-43d5-ab41-4428ca845313 tempest-SnapshotDependencyTests-1615298877 None] Create snapshot completed successfully Jun 12 05:00:16 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.724s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:16 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264 Jun 12 05:00:16 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:17 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" returned: 0 in 0.576s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264" released by "delete_volume" :: held 1.362s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Created reservations ['600b14e9-9cb8-4761-9bce-bf28e38ace26', '564b5f47-23bc-4bf5-8b2a-61f5be140cb7', 'e4a58208-d9c5-47b7-9fdf-e5ab910d7c4c', '457708ef-1164-4f58-9542-75c17f8f839e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:17 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:17 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Flow 'volume_create_manager' (fe4e0047-f9af-4d76-bed4-a7fca26fabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad0a6a7-c6eb-4f1a-a057-9cf6fda9cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad0a6a7-c6eb-4f1a-a057-9cf6fda9cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a60524-260f-4302-b2b6-06249f6103f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ed46c9d07d4654987d73727921332d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70c7134d-ef93-4b7c-b602-8f248d9e05a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:17Z,use_quota=True,user_id='bc27010320514072a1f774bc9cf73254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3b300a-1ccf-4d7a-bdd6-3a27893fa759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3b300a-1ccf-4d7a-bdd6-3a27893fa759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df49ff25-9963-4197-93fa-6b0dbbdd40fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df49ff25-9963-4197-93fa-6b0dbbdd40fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68a60524-260f-4302-b2b6-06249f6103f2', 'volume_name': 'volume-68a60524-260f-4302-b2b6-06249f6103f2', 'volume_size': 1, 'snapshot_id': '70c7134d-ef93-4b7c-b602-8f248d9e05a4'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd82dea0-0af8-4544-82c5-d6317037ed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd82dea0-0af8-4544-82c5-d6317037ed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121c1254-1537-4519-a065-ed49bf57d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:17 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Volume 68a60524-260f-4302-b2b6-06249f6103f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68a60524-260f-4302-b2b6-06249f6103f2', 'volume_size': 1, 'snapshot_id': '70c7134d-ef93-4b7c-b602-8f248d9e05a4'} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-quobyte-70c7134d-ef93-4b7c-b602-8f248d9e05a4-68a60524-260f-4302-b2b6-06249f6103f2" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-70c7134d-ef93-4b7c-b602-8f248d9e05a4-68a60524-260f-4302-b2b6-06249f6103f2" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Creating volume 68a60524-260f-4302-b2b6-06249f6103f2 from snapshot 70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-quobyte-68a60524-260f-4302-b2b6-06249f6103f2" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-68a60524-260f-4302-b2b6-06249f6103f2" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] snapshot: 70c7134d-ef93-4b7c-b602-8f248d9e05a4, volume: 68a60524-260f-4302-b2b6-06249f6103f2, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a59eff-4550-4f06-ad29-87d46639a304]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:17 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 Jun 12 05:00:17 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:18 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.590s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Deleted volume successfully. Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-955a7188-c628-4be5-9abf-d62ac3e3abdc tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-5fe1ee60-c655-48a3-a41d-a9fe6eb1a264-delete_volume" released by "delete_volume" :: held 5.155s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:18 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4" returned: 0 in 0.738s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ac4a971-2b95-41f4-b111-b139c552a126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-15ffbd01-2eba-44ec-a7fa-fa48dc78415e-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-15ffbd01-2eba-44ec-a7fa-fa48dc78415e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed1254-6646-4037-9851-c7622214b57a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "cinder-quobyte-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[762df4d8-f122-4f32-946d-8443ec6d33f8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:18 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:18 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:18 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e Jun 12 05:00:18 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:19 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:19 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 Jun 12 05:00:19 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:19 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" returned: 0 in 0.708s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:19 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e Jun 12 05:00:19 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:19 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" returned: 0 in 0.604s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-quobyte-15ffbd01-2eba-44ec-a7fa-fa48dc78415e" released by "delete_volume" :: held 1.364s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Created reservations ['7aa4b5b4-abe1-49c3-b912-36b73cf62a00', 'c8284307-647a-4ae7-ba48-336d94fd1e3a', 'de8af007-8ff2-4f8f-bfa1-97e6822bd0b6', '2a6eaa24-54a7-48ef-a3f9-ba3d2bc58377'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:20 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:20 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:21 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.122s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:21 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Deleted volume successfully. Jun 12 05:00:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79564b8f-311f-4c6c-bf80-7501cbaea806 tempest-VolumesDeleteCascade-499924855 None] Lock "cinder-15ffbd01-2eba-44ec-a7fa-fa48dc78415e-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:24 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2" returned: 0 in 5.106s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82f372f-e540-487b-a4d2-e878f8359213]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:24 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:24 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:25 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.870s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:00:25 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Converted 1024.00 MB image at 200.51 MB/s Jun 12 05:00:25 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 is being set with open permissions: ugo+rw Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:25 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 Jun 12 05:00:25 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:25 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-68a60524-260f-4302-b2b6-06249f6103f2" released by "_copy_volume_from_snapshot" :: held 8.194s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-70c7134d-ef93-4b7c-b602-8f248d9e05a4-68a60524-260f-4302-b2b6-06249f6103f2" released by "_create_volume_from_snapshot" :: held 8.231s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.248s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Flow 'volume_create_manager' (b63d5e38-3e99-437e-bed8-0c1dd1400837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ead0bfb-7cc7-4830-b4d5-2dc08cd82858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121c1254-1537-4519-a065-ed49bf57d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a60524-260f-4302-b2b6-06249f6103f2', 'volume_size': 1, 'snapshot_id': '70c7134d-ef93-4b7c-b602-8f248d9e05a4'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be598788-d234-49f5-a169-a0b02f390e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ead0bfb-7cc7-4830-b4d5-2dc08cd82858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2139573105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfee8451-4563-402b-9ccd-e5e503c97517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547bac70f76b487cad9c844ce6add27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:26Z,use_quota=True,user_id='88d85c00591c4e63a7a445b256ccc47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c6825f-0896-4a21-b8d1-cd282cd39720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c6825f-0896-4a21-b8d1-cd282cd39720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0683007-b44e-4775-959b-8a28c431c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0683007-b44e-4775-959b-8a28c431c667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfee8451-4563-402b-9ccd-e5e503c97517', 'volume_name': 'volume-bfee8451-4563-402b-9ccd-e5e503c97517', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8ed23f-f332-4aac-b3d8-d0381f781daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8ed23f-f332-4aac-b3d8-d0381f781daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2419835-b9ed-4ee3-9494-78b8553644e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:25 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Volume bfee8451-4563-402b-9ccd-e5e503c97517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfee8451-4563-402b-9ccd-e5e503c97517', 'volume_size': 1} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2139573105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfee8451-4563-402b-9ccd-e5e503c97517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547bac70f76b487cad9c844ce6add27f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:26Z,use_quota=True,user_id='88d85c00591c4e63a7a445b256ccc47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Creating volume bfee8451-4563-402b-9ccd-e5e503c97517 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:00:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:26 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:26 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Volume volume-68a60524-260f-4302-b2b6-06249f6103f2 (68a60524-260f-4302-b2b6-06249f6103f2): created successfully Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be598788-d234-49f5-a169-a0b02f390e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:26 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 1073741824 Jun 12 05:00:26 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Flow 'volume_create_manager' (fe4e0047-f9af-4d76-bed4-a7fca26fabbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-85e449d0-f698-4261-8911-611526ff0019 tempest-SnapshotDependencyTests-1615298877 None] Created volume successfully. Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-70c7134d-ef93-4b7c-b602-8f248d9e05a4-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-70c7134d-ef93-4b7c-b602-8f248d9e05a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-quobyte-4ac4a971-2b95-41f4-b111-b139c552a126" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-4ac4a971-2b95-41f4-b111-b139c552a126" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-quobyte-70c7134d-ef93-4b7c-b602-8f248d9e05a4" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-70c7134d-ef93-4b7c-b602-8f248d9e05a4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Deleting offline snapshot 70c7134d-ef93-4b7c-b602-8f248d9e05a4 of volume 4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] snapshot_file for this snap is: volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de74c8a-e597-482e-800d-f170202479c1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:26 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 Jun 12 05:00:26 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:26 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 1073741824" returned: 0 in 0.830s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:26 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 Jun 12 05:00:26 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:27 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4" returned: 0 in 0.747s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ac4a971-2b95-41f4-b111-b139c552a126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dbb4b5-7be8-4e87-baf7-41f30a571099]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:27 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:27 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:27 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517" returned: 0 in 0.584s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2419835-b9ed-4ee3-9494-78b8553644e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfee8451-4563-402b-9ccd-e5e503c97517', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea47bd2-bf87-43eb-a5e7-9058090bca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:27 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Volume volume-bfee8451-4563-402b-9ccd-e5e503c97517 (bfee8451-4563-402b-9ccd-e5e503c97517): created successfully Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea47bd2-bf87-43eb-a5e7-9058090bca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Flow 'volume_create_manager' (b63d5e38-3e99-437e-bed8-0c1dd1400837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6f82d6b2-60fb-4ac8-9284-3b0e3d59bc48 tempest-VolumesMetadataTest-164390658 None] Created volume successfully. Jun 12 05:00:28 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.682s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:28 devstack sudo[109315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 Jun 12 05:00:28 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Acquiring lock "cinder-bfee8451-4563-402b-9ccd-e5e503c97517-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:28 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Lock "cinder-bfee8451-4563-402b-9ccd-e5e503c97517-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:28 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4 Jun 12 05:00:28 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Acquiring lock "cinder-quobyte-bfee8451-4563-402b-9ccd-e5e503c97517" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Lock "cinder-quobyte-bfee8451-4563-402b-9ccd-e5e503c97517" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b23af-0595-4ceb-9002-319155cf57e8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:28 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 Jun 12 05:00:28 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:29 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126.70c7134d-ef93-4b7c-b602-8f248d9e05a4" returned: 0 in 0.627s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-70c7134d-ef93-4b7c-b602-8f248d9e05a4" released by "_delete_snapshot" :: held 2.878s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-4ac4a971-2b95-41f4-b111-b139c552a126" released by "delete_snapshot" :: held 2.909s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Created reservations ['480523ef-3afc-4648-9cc0-8ba8dd62afc5', '19247bb6-17dd-44e7-bca0-39dbdb329172', '52c1451e-df76-428f-86b7-db154ee1a09c', '4bf36fe0-9ebb-459e-9de9-3701c81eb40d'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Delete snapshot completed successfully. Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d9971f7b-e779-4d7f-81b1-397d89338bac tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-70c7134d-ef93-4b7c-b602-8f248d9e05a4-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:29 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517" returned: 0 in 0.700s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:29 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517 Jun 12 05:00:29 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-4ac4a971-2b95-41f4-b111-b139c552a126-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-4ac4a971-2b95-41f4-b111-b139c552a126-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-quobyte-4ac4a971-2b95-41f4-b111-b139c552a126" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-4ac4a971-2b95-41f4-b111-b139c552a126" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[55447d0b-89d2-4e37-88e5-d4a0b439c2fa]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:29 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:29 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:30 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bfee8451-4563-402b-9ccd-e5e503c97517" returned: 0 in 0.598s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Lock "cinder-quobyte-bfee8451-4563-402b-9ccd-e5e503c97517" released by "delete_volume" :: held 1.349s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Created reservations ['403b44e8-f4c7-4a89-a31a-cb087371c6df', '6e70c4cb-e7f0-491b-b022-92f0503f454c', '335090db-e851-47c1-b9a1-00b276a1f775', '67f03e09-5329-4a34-8af0-c9d95ba40404'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:30 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:30 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:30 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:30 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126 Jun 12 05:00:30 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:30 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Deleted volume successfully. Jun 12 05:00:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-88b1f5b0-2af3-4362-9340-7ae9493a6252 tempest-VolumesMetadataTest-164390658 None] Lock "cinder-bfee8451-4563-402b-9ccd-e5e503c97517-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:31 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4ac4a971-2b95-41f4-b111-b139c552a126" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-4ac4a971-2b95-41f4-b111-b139c552a126" released by "delete_volume" :: held 1.359s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Created reservations ['7339eaaf-7a1d-4609-999a-245de78edda7', '6587177a-e8c5-415b-9918-1e374c22100e', '26a9a2f1-ee75-4c3b-8be6-ff884acc265b', '39ffc627-7fca-48e8-baf1-1cbd58803077'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:31 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:31 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:31 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:31 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:31 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.613s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Deleted volume successfully. Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8351063e-6620-4fda-9244-8158f48e7c02 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-4ac4a971-2b95-41f4-b111-b139c552a126-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-68a60524-260f-4302-b2b6-06249f6103f2-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-68a60524-260f-4302-b2b6-06249f6103f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "cinder-quobyte-68a60524-260f-4302-b2b6-06249f6103f2" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-68a60524-260f-4302-b2b6-06249f6103f2" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[00709a23-51f9-4f0a-9a8d-5e45074f978b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:32 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 Jun 12 05:00:32 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:32 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:00:32 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2" returned: 0 in 0.757s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:32 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2 Jun 12 05:00:32 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:33 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-68a60524-260f-4302-b2b6-06249f6103f2" returned: 0 in 0.626s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-quobyte-68a60524-260f-4302-b2b6-06249f6103f2" released by "delete_volume" :: held 1.430s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=99,cinder:UPDATE=114,cinder:INSERT=29,cinder:DELETE=8 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=93,cinder:INSERT=31,cinder:UPDATE=115,cinder:DELETE=11 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Created reservations ['196f4cdd-c14d-494f-bb9d-8fe8f029c787', '83b9b173-abfb-4eeb-9480-97b2e238f2c2', 'c945ab16-89c6-4e33-b35e-74564907f3eb', '2cab6cb8-6764-49c9-9202-7dbdf8362ae6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:33 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:33 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:34 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.625s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:34 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Deleted volume successfully. Jun 12 05:00:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-de563548-9e6f-4ff9-99da-d271fe97ec06 tempest-SnapshotDependencyTests-1615298877 None] Lock "cinder-68a60524-260f-4302-b2b6-06249f6103f2-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Flow 'volume_create_manager' (ef902488-4bbe-4e46-9d65-5ed153f4195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b464542-c214-4f18-ac0c-f3959cf5378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b464542-c214-4f18-ac0c-f3959cf5378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-17024499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b04cc7-1e3c-4722-b89e-6969999af7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd78ab7cac6440d9b83071b1f97ef990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:35Z,use_quota=True,user_id='dc2ad6df4065463280f7969912805a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f0fbe7-2609-4d71-b293-3b99c9804136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f0fbe7-2609-4d71-b293-3b99c9804136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88a14cf-002f-479a-a52a-dcb2ff197ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88a14cf-002f-479a-a52a-dcb2ff197ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b04cc7-1e3c-4722-b89e-6969999af7ad', 'volume_name': 'volume-46b04cc7-1e3c-4722-b89e-6969999af7ad', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6ec986-4a2c-468f-820e-f6c7a710b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6ec986-4a2c-468f-820e-f6c7a710b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c56538-82c1-4f3f-abfc-d4fd6e941a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Volume 46b04cc7-1e3c-4722-b89e-6969999af7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b04cc7-1e3c-4722-b89e-6969999af7ad', 'volume_size': 1} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-17024499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b04cc7-1e3c-4722-b89e-6969999af7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd78ab7cac6440d9b83071b1f97ef990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:35Z,use_quota=True,user_id='dc2ad6df4065463280f7969912805a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Creating volume 46b04cc7-1e3c-4722-b89e-6969999af7ad {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:35 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:00:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:35 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad 1073741824 Jun 12 05:00:35 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:36 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad 1073741824" returned: 0 in 0.866s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:36 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad Jun 12 05:00:36 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:36 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad" returned: 0 in 0.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c56538-82c1-4f3f-abfc-d4fd6e941a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b04cc7-1e3c-4722-b89e-6969999af7ad', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698cb057-01fc-4c52-8e1f-9cd2173fe218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Volume volume-46b04cc7-1e3c-4722-b89e-6969999af7ad (46b04cc7-1e3c-4722-b89e-6969999af7ad): created successfully Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698cb057-01fc-4c52-8e1f-9cd2173fe218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Flow 'volume_create_manager' (ef902488-4bbe-4e46-9d65-5ed153f4195c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5ca74730-cc42-4418-83f2-5297cc1997fc tempest-VolumesTransfersV355Test-1013144186 None] Created volume successfully. Jun 12 05:00:37 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-547ac46d-3e65-4e1e-80fe-f8e870c2c061 tempest-VolumesTransfersV355Test-1286395261 None] Transfer volume completed successfully. Jun 12 05:00:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Acquiring lock "cinder-46b04cc7-1e3c-4722-b89e-6969999af7ad-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-46b04cc7-1e3c-4722-b89e-6969999af7ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Acquiring lock "cinder-quobyte-46b04cc7-1e3c-4722-b89e-6969999af7ad" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-quobyte-46b04cc7-1e3c-4722-b89e-6969999af7ad" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:38 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed590b6e-605c-49bc-8b37-c2869a6d4d42]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:38 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad Jun 12 05:00:38 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:39 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad" returned: 0 in 0.735s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:39 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad Jun 12 05:00:39 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:40 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-46b04cc7-1e3c-4722-b89e-6969999af7ad" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-quobyte-46b04cc7-1e3c-4722-b89e-6969999af7ad" released by "delete_volume" :: held 1.394s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Created reservations ['c9103d3f-1206-4940-b044-e3bf13192bbd', 'e08fc550-a35b-4187-8d10-a77276fe6c79', '6f36a80e-5a81-4f40-9407-6f07c5381909', '8195ee6b-425a-46ad-96e1-4d7bee09bea8'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:40 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:40 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:40 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:41 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Deleted volume successfully. Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2af17e33-dba1-48f2-8842-20231221dd11 tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-46b04cc7-1e3c-4722-b89e-6969999af7ad-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Flow 'volume_create_manager' (9cb79905-7005-4c77-a942-07487aa5197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4063c3f1-9e07-43b2-961c-d413f04f0a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4063c3f1-9e07-43b2-961c-d413f04f0a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-694061395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a490de06-adff-4de0-a30a-88b83923d43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd78ab7cac6440d9b83071b1f97ef990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:41Z,use_quota=True,user_id='dc2ad6df4065463280f7969912805a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1479b063-ae5a-4efc-bec7-fb249618926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1479b063-ae5a-4efc-bec7-fb249618926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547ebdc1-a348-47b3-93d6-0df86ed9581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547ebdc1-a348-47b3-93d6-0df86ed9581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a490de06-adff-4de0-a30a-88b83923d43e', 'volume_name': 'volume-a490de06-adff-4de0-a30a-88b83923d43e', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175b2177-e381-49b1-ba21-f72f2cee1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175b2177-e381-49b1-ba21-f72f2cee1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aa152c-b26e-4dc3-965e-e5863112b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:41 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Volume a490de06-adff-4de0-a30a-88b83923d43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a490de06-adff-4de0-a30a-88b83923d43e', 'volume_size': 1} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-694061395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a490de06-adff-4de0-a30a-88b83923d43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd78ab7cac6440d9b83071b1f97ef990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:41Z,use_quota=True,user_id='dc2ad6df4065463280f7969912805a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Creating volume a490de06-adff-4de0-a30a-88b83923d43e {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:41 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:00:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:41 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e 1073741824 Jun 12 05:00:41 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:42 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e 1073741824" returned: 0 in 0.804s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:42 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e Jun 12 05:00:42 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:43 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aa152c-b26e-4dc3-965e-e5863112b6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a490de06-adff-4de0-a30a-88b83923d43e', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3682ef86-2384-4fd8-a850-ec55480c0c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:43 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Volume volume-a490de06-adff-4de0-a30a-88b83923d43e (a490de06-adff-4de0-a30a-88b83923d43e): created successfully Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3682ef86-2384-4fd8-a850-ec55480c0c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Flow 'volume_create_manager' (9cb79905-7005-4c77-a942-07487aa5197d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f02d3fb8-4f98-4450-a470-6d9f69cfb763 tempest-VolumesTransfersV355Test-1013144186 None] Created volume successfully. Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Acquiring lock "cinder-a490de06-adff-4de0-a30a-88b83923d43e-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-a490de06-adff-4de0-a30a-88b83923d43e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Acquiring lock "cinder-quobyte-a490de06-adff-4de0-a30a-88b83923d43e" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-quobyte-a490de06-adff-4de0-a30a-88b83923d43e" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05dc9ed-404b-474b-96aa-b95596ce591a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:44 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e Jun 12 05:00:44 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:44 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e" returned: 0 in 0.682s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:44 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e Jun 12 05:00:44 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:45 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a490de06-adff-4de0-a30a-88b83923d43e" returned: 0 in 0.571s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-quobyte-a490de06-adff-4de0-a30a-88b83923d43e" released by "delete_volume" :: held 1.288s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Created reservations ['869118da-c41a-4a5e-adec-1fb4e5bef9f2', 'ffb60b00-5cb0-401f-b7f7-10f39084dff0', '46f3c834-90f5-46bf-87a0-f27be2a32816', '57cf8bea-c0b8-48b7-9c54-502423c63215'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:45 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:00:45 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:45 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:00:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Deleted volume successfully. Jun 12 05:00:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4a9d45f9-de15-4bf5-88dc-33020768518e tempest-VolumesTransfersV355Test-1263246760 None] Lock "cinder-a490de06-adff-4de0-a30a-88b83923d43e-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:00:50 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:00:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Flow 'volume_create_manager' (da92a709-2bba-40bb-906a-044bc3083c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:00:50 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab3f489-bfe9-4af1-8f21-ecfa3ebedd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab3f489-bfe9-4af1-8f21-ecfa3ebedd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1036205374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019728b0-4460-43a0-aa89-a6d271fe32af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c685df8bb84413a0b0dc3a902eaf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:51Z,use_quota=True,user_id='b3c66a234cb34e8ea5a29509bfd65e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf0db6e-26d6-413f-9e94-c9227ef2af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf0db6e-26d6-413f-9e94-c9227ef2af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8492a07e-7e13-45c4-8b28-bc6ef070877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8492a07e-7e13-45c4-8b28-bc6ef070877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '019728b0-4460-43a0-aa89-a6d271fe32af', 'volume_name': 'volume-019728b0-4460-43a0-aa89-a6d271fe32af', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc02ba72-1207-4d84-98b8-b4f754d68ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc02ba72-1207-4d84-98b8-b4f754d68ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcfcad3-4574-45ae-a9c0-6d23c3b8d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:00:51 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Volume 019728b0-4460-43a0-aa89-a6d271fe32af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-019728b0-4460-43a0-aa89-a6d271fe32af', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Trying to clone 019728b0-4460-43a0-aa89-a6d271fe32af from image 23fce906-aa03-46a6-9408-5b9570e89c54 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 05:00:51 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Image download 20.69 MB at 20.69 MB/s Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe876b-07f0-4435-9390-b73d55b78852]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:51 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD Jun 12 05:00:51 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:52 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 is fetched for user b3c66a234cb34e8ea5a29509bfd65e91. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dfab4d-1c1f-4c62-9821-beee93f6b0e1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:52 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD Jun 12 05:00:52 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:52 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1036205374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019728b0-4460-43a0-aa89-a6d271fe32af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c685df8bb84413a0b0dc3a902eaf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:00:51Z,use_quota=True,user_id='b3c66a234cb34e8ea5a29509bfd65e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Creating volume 019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:00:52 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:00:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:53 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 1073741824 Jun 12 05:00:53 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:53 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 1073741824" returned: 0 in 0.742s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:53 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:00:53 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:54 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 0 in 0.589s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:00:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:00:54 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Attempting download of 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume 019728b0-4460-43a0-aa89-a6d271fe32af. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 05:00:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0dc132-3ad7-434f-8676-eb0081634b58]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:54 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3 Jun 12 05:00:54 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:55 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3" returned: 0 in 0.650s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:55 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3 Jun 12 05:00:55 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:55 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3" returned: 1 in 0.673s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23fce906-aa03-46a6-9408-5b9570e89c54_hze0bnc3' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:00:55 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc60d89-89cd-42d1-b968-0f140edaec6c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:55 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD Jun 12 05:00:55 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:56 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:56 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] 23fce906-aa03-46a6-9408-5b9570e89c54 was qcow2, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 05:00:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:56 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:00:56 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:58 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 0 in 1.708s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:58 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23fce906-aa03-46a6-9408-5b9570e89c54_xzaw0d7udevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:00:58 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Converted 112.00 MB image at 65.52 MB/s Jun 12 05:00:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:58 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 1G Jun 12 05:00:58 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:58 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 1G" returned: 0 in 0.646s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:58 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc39cb74-140d-4a3f-ae3b-0535576eecfd]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:00:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:58 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:00:58 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:00:59 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Jun 12 05:00:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 0 in 0.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:00:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:00:59 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:00:59 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:00 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 1 in 0.670s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Downloaded image 23fce906-aa03-46a6-9408-5b9570e89c54 ((None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}])) to volume 019728b0-4460-43a0-aa89-a6d271fe32af successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Temporary image 23fce906-aa03-46a6-9408-5b9570e89c54 for user b3c66a234cb34e8ea5a29509bfd65e91 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Marking volume 019728b0-4460-43a0-aa89-a6d271fe32af as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Copying metadata from image 23fce906-aa03-46a6-9408-5b9570e89c54 to 019728b0-4460-43a0-aa89-a6d271fe32af. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Creating volume glance metadata for volume 019728b0-4460-43a0-aa89-a6d271fe32af backed by image 23fce906-aa03-46a6-9408-5b9570e89c54 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcfcad3-4574-45ae-a9c0-6d23c3b8d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019728b0-4460-43a0-aa89-a6d271fe32af', 'volume_size': 1, 'image_id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23fce906-aa03-46a6-9408-5b9570e89c54', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c675c3a2bc6843d3a5af9d4974131eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23fce906-aa03-46a6-9408-5b9570e89c54', 'created_at': datetime.datetime(2026, 6, 12, 2, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 2, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23fce906-aa03-46a6-9408-5b9570e89c54/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07738e1-b6b7-44b0-a9ba-61bbf1cb1dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:00 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Volume volume-019728b0-4460-43a0-aa89-a6d271fe32af (019728b0-4460-43a0-aa89-a6d271fe32af): created successfully Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07738e1-b6b7-44b0-a9ba-61bbf1cb1dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Flow 'volume_create_manager' (da92a709-2bba-40bb-906a-044bc3083c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b15477d4-61f7-4c10-a7f8-13f2f151c83c tempest-VolumesExtendTest-2039143283 None] Created volume successfully. Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b1bdf-a71b-4002-8034-f324f0aa7a4a]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:00 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:01:00 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:01 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 0 in 0.711s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:01 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:01:01 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:01 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 1 in 0.670s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 2G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af 2G" returned: 0 in 0.054s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.480s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-5c7dc371-2213-4893-a754-3b77c32d43ad tempest-VolumesExtendTest-2039143283 None] Extend volume completed successfully. Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-019728b0-4460-43a0-aa89-a6d271fe32af-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-019728b0-4460-43a0-aa89-a6d271fe32af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-quobyte-019728b0-4460-43a0-aa89-a6d271fe32af" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-019728b0-4460-43a0-aa89-a6d271fe32af" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:03 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6567f6-fcd8-472a-95f5-6915d8f3039c]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:03 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:01:03 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:03 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:03 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:01:03 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:04 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 1 in 0.664s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:01:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:04 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af Jun 12 05:01:04 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:04 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-019728b0-4460-43a0-aa89-a6d271fe32af" returned: 0 in 0.564s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:04 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-019728b0-4460-43a0-aa89-a6d271fe32af" released by "delete_volume" :: held 1.966s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:04 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Created reservations ['2fc51675-933e-4e03-ab19-435017f3cc62', '5284d562-1941-4697-bd0d-a503ad24e3e7', '1eb0f42f-ce14-4ead-a3f4-0f7722833333', '5386c5a3-110b-4cbf-9e9c-99713460af4c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:05 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:01:05 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Flow 'volume_create_manager' (6ce09722-8237-4169-bb84-d6aa32aee5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfc2af4-2379-47a9-bc4b-20b3775bd1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfc2af4-2379-47a9-bc4b-20b3775bd1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1520785385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61da1997-abd9-418c-b5c5-bb37ea389578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c685df8bb84413a0b0dc3a902eaf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:05Z,use_quota=True,user_id='b3c66a234cb34e8ea5a29509bfd65e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2e71d6-ad7c-477a-9401-74130a960a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2e71d6-ad7c-477a-9401-74130a960a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c76a8d-32fa-4f3c-a327-2349e73f7e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c76a8d-32fa-4f3c-a327-2349e73f7e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61da1997-abd9-418c-b5c5-bb37ea389578', 'volume_name': 'volume-61da1997-abd9-418c-b5c5-bb37ea389578', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d79242a-0835-407a-ad53-0e805f048d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d79242a-0835-407a-ad53-0e805f048d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6463e9-e9f7-43b6-ace8-cf54fa115fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Volume 61da1997-abd9-418c-b5c5-bb37ea389578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61da1997-abd9-418c-b5c5-bb37ea389578', 'volume_size': 1} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1520785385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61da1997-abd9-418c-b5c5-bb37ea389578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c685df8bb84413a0b0dc3a902eaf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:05Z,use_quota=True,user_id='b3c66a234cb34e8ea5a29509bfd65e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Creating volume 61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:01:05 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:05 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 1073741824 Jun 12 05:01:05 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:05 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.600s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:01:05 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Deleted volume successfully. Jun 12 05:01:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-bf456c13-0649-46aa-beea-fe0a9ec27f03 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-019728b0-4460-43a0-aa89-a6d271fe32af-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:06 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 1073741824" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:06 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 Jun 12 05:01:06 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:06 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6463e9-e9f7-43b6-ace8-cf54fa115fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61da1997-abd9-418c-b5c5-bb37ea389578', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca9c661-f9f1-4caa-9049-df29f081a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:07 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Volume volume-61da1997-abd9-418c-b5c5-bb37ea389578 (61da1997-abd9-418c-b5c5-bb37ea389578): created successfully Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca9c661-f9f1-4caa-9049-df29f081a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Flow 'volume_create_manager' (6ce09722-8237-4169-bb84-d6aa32aee5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-253b19bb-c2b9-4985-ae71-689b576723c0 tempest-VolumesExtendTest-2039143283 None] Created volume successfully. Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Creating offline snapshot 4b07c7a2-b180-4477-8269-fb23135077de of volume 61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1ecb81-97c9-4c45-b3c1-6f9a5c5d45ea]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:07 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 Jun 12 05:01:07 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:08 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578" returned: 0 in 0.679s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:08 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de 1G Jun 12 05:01:08 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:09 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de 1G" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61da1997-abd9-418c-b5c5-bb37ea389578 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:09 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61da1997-abd9-418c-b5c5-bb37ea389578 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de Jun 12 05:01:09 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:09 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61da1997-abd9-418c-b5c5-bb37ea389578 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de" returned: 0 in 0.641s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:09 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de is being set with open permissions: ugo+rw Jun 12 05:01:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:09 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de Jun 12 05:01:09 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:10 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de" returned: 0 in 0.574s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:10 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info Jun 12 05:01:10 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:11 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:11 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info is being set with open permissions: ugo+rw Jun 12 05:01:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:11 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info Jun 12 05:01:11 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:11 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.info" returned: 0 in 0.584s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.875s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-292715bf-ca27-4022-987d-052d7bd2757d tempest-VolumesExtendTest-2039143283 None] Create snapshot completed successfully Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17e6217-7258-40ad-b825-e55bb30a9c8b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:12 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 Jun 12 05:01:12 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:12 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578" returned: 0 in 0.687s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de 2G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de 2G" returned: 0 in 0.113s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.832s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a8eda7e5-5d67-409d-8540-1b04e37c1270 tempest-VolumesExtendTest-2039143283 None] Extend volume completed successfully. Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-4b07c7a2-b180-4477-8269-fb23135077de-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-4b07c7a2-b180-4477-8269-fb23135077de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-quobyte-61da1997-abd9-418c-b5c5-bb37ea389578" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-61da1997-abd9-418c-b5c5-bb37ea389578" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-quobyte-4b07c7a2-b180-4477-8269-fb23135077de" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-4b07c7a2-b180-4477-8269-fb23135077de" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Deleting offline snapshot 4b07c7a2-b180-4477-8269-fb23135077de of volume 61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] snapshot_file for this snap is: volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe5092-861f-4257-8cfe-41a113053506]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:13 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de Jun 12 05:01:13 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:13 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de" returned: 0 in 0.686s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:13 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61da1997-abd9-418c-b5c5-bb37ea389578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:01:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3bd7e-36a2-4811-8a19-0837c5dbb114]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:14 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 Jun 12 05:01:14 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:14 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578" returned: 0 in 0.672s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:14 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de Jun 12 05:01:14 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:15 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de" returned: 0 in 0.688s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:15 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de Jun 12 05:01:15 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:15 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578.4b07c7a2-b180-4477-8269-fb23135077de" returned: 0 in 0.571s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-4b07c7a2-b180-4477-8269-fb23135077de" released by "_delete_snapshot" :: held 2.711s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-61da1997-abd9-418c-b5c5-bb37ea389578" released by "delete_snapshot" :: held 2.732s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Created reservations ['035dc3d5-6ea0-42a4-bff6-080370ddd990', 'e3841a05-2c50-4d48-bc1f-c077f944f273', '0f407eab-2290-4059-ba48-2aefed812edd', '18e9e69c-9de1-4c7a-ae7f-03764877383f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:01:16 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Delete snapshot completed successfully. Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c4ec8b29-760f-4730-81e1-7c89862cab00 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-4b07c7a2-b180-4477-8269-fb23135077de-delete_snapshot" released by "delete_snapshot" :: held 2.850s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-61da1997-abd9-418c-b5c5-bb37ea389578-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-61da1997-abd9-418c-b5c5-bb37ea389578-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "cinder-quobyte-61da1997-abd9-418c-b5c5-bb37ea389578" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-61da1997-abd9-418c-b5c5-bb37ea389578" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798d56a-05f9-4d87-9980-773c60bd6cf0]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:16 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 Jun 12 05:01:16 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:17 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:17 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578 Jun 12 05:01:17 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:17 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-61da1997-abd9-418c-b5c5-bb37ea389578" returned: 0 in 0.573s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-quobyte-61da1997-abd9-418c-b5c5-bb37ea389578" released by "delete_volume" :: held 1.304s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Created reservations ['a7556658-1e8b-44dc-a40d-c1555c078467', '6c5f53c3-b48e-46e0-bdd3-4ffa743cfba8', 'ac9e35d3-61ac-429c-bc65-c5061c4f6cc0', 'bfcffa62-0e7e-4b3e-9905-1da1eb218e25'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:17 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:01:17 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:18 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.573s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:18 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:01:18 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Deleted volume successfully. Jun 12 05:01:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3e096031-d2c4-425c-ba2b-cd9f34e7b706 tempest-VolumesExtendTest-2039143283 None] Lock "cinder-61da1997-abd9-418c-b5c5-bb37ea389578-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Flow 'volume_create_manager' (9fe3258a-aaab-4fdd-bc1e-61fb3f1cf34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d80197e-2a99-4d2f-a508-64314f9bbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d80197e-2a99-4d2f-a508-64314f9bbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1623238227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf4abde-4977-4eec-9f11-4a547b0cb932,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261614f8d990443d8841f647b8f951c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:21Z,use_quota=True,user_id='fb45a4861293468e8d31aa980a03970a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11d86e3-1353-4a35-9af9-e34484315e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11d86e3-1353-4a35-9af9-e34484315e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2372b95-5bf1-476b-919c-d4689981d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2372b95-5bf1-476b-919c-d4689981d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf4abde-4977-4eec-9f11-4a547b0cb932', 'volume_name': 'volume-bbf4abde-4977-4eec-9f11-4a547b0cb932', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fe5a24-1a68-4df5-b94f-06a557d3e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fe5a24-1a68-4df5-b94f-06a557d3e268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f9a9a7-b8fb-4f35-89e7-b13bc00708b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:21 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Volume bbf4abde-4977-4eec-9f11-4a547b0cb932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf4abde-4977-4eec-9f11-4a547b0cb932', 'volume_size': 1} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1623238227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf4abde-4977-4eec-9f11-4a547b0cb932,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261614f8d990443d8841f647b8f951c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:21Z,use_quota=True,user_id='fb45a4861293468e8d31aa980a03970a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Creating volume bbf4abde-4977-4eec-9f11-4a547b0cb932 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:01:21 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:21 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 1073741824 Jun 12 05:01:21 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:21 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 1073741824" returned: 0 in 0.734s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:21 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 Jun 12 05:01:21 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:22 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932" returned: 0 in 0.560s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f9a9a7-b8fb-4f35-89e7-b13bc00708b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf4abde-4977-4eec-9f11-4a547b0cb932', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d29538-ad9f-4f2a-a04d-878293bd3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:22 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Volume volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 (bbf4abde-4977-4eec-9f11-4a547b0cb932): created successfully Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d29538-ad9f-4f2a-a04d-878293bd3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Flow 'volume_create_manager' (9fe3258a-aaab-4fdd-bc1e-61fb3f1cf34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0a7d8eaa-f7d8-4241-8f6c-7cd5c7de4b54 tempest-VolumesListTestJSON-731589426 None] Created volume successfully. Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Flow 'volume_create_manager' (5256ec1c-51d7-45df-ba90-c7f44a6fd97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a089c1d2-a6c0-44c2-b9e3-ea0a9cf15312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a089c1d2-a6c0-44c2-b9e3-ea0a9cf15312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1311937351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261614f8d990443d8841f647b8f951c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:24Z,use_quota=True,user_id='fb45a4861293468e8d31aa980a03970a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79368729-628f-4042-b5e5-0470dcc3ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79368729-628f-4042-b5e5-0470dcc3ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2cc89e-c481-4705-b954-c44aea4e464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2cc89e-c481-4705-b954-c44aea4e464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2', 'volume_name': 'volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3fe718-9c14-4134-9153-72f830cc5a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3fe718-9c14-4134-9153-72f830cc5a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edd4d02-7a59-4fb1-a2fc-29b426d0a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Volume 8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2', 'volume_size': 1} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1311937351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261614f8d990443d8841f647b8f951c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:24Z,use_quota=True,user_id='fb45a4861293468e8d31aa980a03970a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Creating volume 8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:01:23 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:01:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:23 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 1073741824 Jun 12 05:01:23 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:24 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 1073741824" returned: 0 in 0.746s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:24 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 Jun 12 05:01:24 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:24 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2" returned: 0 in 0.591s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edd4d02-7a59-4fb1-a2fc-29b426d0a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca249f56-d617-4a45-88ce-d4f6e908aa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:25 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Volume volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 (8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2): created successfully Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca249f56-d617-4a45-88ce-d4f6e908aa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Flow 'volume_create_manager' (5256ec1c-51d7-45df-ba90-c7f44a6fd97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:25 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9539211c-bd35-47fb-87e7-22b739d0b88f tempest-VolumesListTestJSON-731589426 None] Created volume successfully. Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Flow 'volume_create_manager' (c0f0da86-fb9c-4fbc-8093-05eae50ba418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5cc86-6463-466b-ba88-e16156a8e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5cc86-6463-466b-ba88-e16156a8e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-767276658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386a37d1-5ecb-4a33-98fd-699e998d9cef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261614f8d990443d8841f647b8f951c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:26Z,use_quota=True,user_id='fb45a4861293468e8d31aa980a03970a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b1e31a-29ce-4258-a323-bf0826a18f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b1e31a-29ce-4258-a323-bf0826a18f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555a19fc-4c7b-42c3-a795-488a92d992d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555a19fc-4c7b-42c3-a795-488a92d992d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386a37d1-5ecb-4a33-98fd-699e998d9cef', 'volume_name': 'volume-386a37d1-5ecb-4a33-98fd-699e998d9cef', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8dd09e-cb53-431a-b95c-ec0a0a82402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8dd09e-cb53-431a-b95c-ec0a0a82402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b648e77-d23c-4eac-a324-f08d2b78c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:26 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Volume 386a37d1-5ecb-4a33-98fd-699e998d9cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386a37d1-5ecb-4a33-98fd-699e998d9cef', 'volume_size': 1} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-767276658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386a37d1-5ecb-4a33-98fd-699e998d9cef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='261614f8d990443d8841f647b8f951c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:26Z,use_quota=True,user_id='fb45a4861293468e8d31aa980a03970a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Creating volume 386a37d1-5ecb-4a33-98fd-699e998d9cef {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:01:26 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:26 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef 1073741824 Jun 12 05:01:26 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:26 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef 1073741824" returned: 0 in 0.745s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:26 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef Jun 12 05:01:26 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:27 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef" returned: 0 in 0.571s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b648e77-d23c-4eac-a324-f08d2b78c16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386a37d1-5ecb-4a33-98fd-699e998d9cef', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dd05e2-1e9c-4661-b5da-e9abe873be2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:27 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Volume volume-386a37d1-5ecb-4a33-98fd-699e998d9cef (386a37d1-5ecb-4a33-98fd-699e998d9cef): created successfully Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dd05e2-1e9c-4661-b5da-e9abe873be2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:27 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Flow 'volume_create_manager' (c0f0da86-fb9c-4fbc-8093-05eae50ba418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-425c22f0-60d1-4103-bb94-2436abaccff8 tempest-VolumesListTestJSON-731589426 None] Created volume successfully. Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "cinder-386a37d1-5ecb-4a33-98fd-699e998d9cef-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-386a37d1-5ecb-4a33-98fd-699e998d9cef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "cinder-quobyte-386a37d1-5ecb-4a33-98fd-699e998d9cef" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-quobyte-386a37d1-5ecb-4a33-98fd-699e998d9cef" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[86185609-3a14-42cb-9ae4-9630b8ca51d3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:30 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef Jun 12 05:01:30 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:30 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:30 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef Jun 12 05:01:30 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:31 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-386a37d1-5ecb-4a33-98fd-699e998d9cef" returned: 0 in 0.590s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-quobyte-386a37d1-5ecb-4a33-98fd-699e998d9cef" released by "delete_volume" :: held 1.305s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Created reservations ['02cabf59-8f6d-4edc-9b0c-253efb7b3390', '7144e04b-6ea0-4c43-a893-a7109d877880', 'b2634eaf-bc47-44e1-9db0-0f4c535764c1', '97608c67-b72f-4e08-b8d0-1c99dfedb01f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:31 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:01:31 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:31 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:01:31 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:32 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.592s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:01:32 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Deleted volume successfully. Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4e843b81-0d91-45e1-8641-45cf5ddb8f31 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-386a37d1-5ecb-4a33-98fd-699e998d9cef-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Acquiring lock "cinder-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Lock "cinder-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:32 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Acquiring lock "cinder-quobyte-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Lock "cinder-quobyte-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e41c8e7-4841-4469-bc11-8a3e3f283dd5]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:32 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 Jun 12 05:01:32 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:33 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2" returned: 0 in 0.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:33 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2 Jun 12 05:01:33 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:33 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Lock "cinder-quobyte-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2" released by "delete_volume" :: held 1.285s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=61,cinder:INSERT=28,cinder:UPDATE=82,cinder:DELETE=9 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:INSERT=21,cinder:UPDATE=83,cinder:SELECT=67,cinder:DELETE=5 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Created reservations ['0c0db855-8616-4ad3-a2df-7d79cad6a4b2', '6e54380b-1060-4406-8365-b0830b4c0f0d', 'b3e77b22-624f-4204-a0dd-c6838b03eb44', '52c3c26f-c647-4c3e-aa9d-13e36971fa85'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:33 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:01:33 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:34 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.579s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:01:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Deleted volume successfully. Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8ebbe290-241e-4519-91a0-82453b14b0ad tempest-VolumesListTestJSON-731589426 None] Lock "cinder-8e34ca4e-c5a0-4f3c-b58c-c5dce58cade2-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "cinder-bbf4abde-4977-4eec-9f11-4a547b0cb932-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-bbf4abde-4977-4eec-9f11-4a547b0cb932-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "cinder-quobyte-bbf4abde-4977-4eec-9f11-4a547b0cb932" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-quobyte-bbf4abde-4977-4eec-9f11-4a547b0cb932" acquired by "delete_volume" :: waited 0.012s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f2e009-c2a7-488e-8e3d-97d53742483a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:01:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:34 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 Jun 12 05:01:34 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:35 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932" returned: 0 in 0.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:35 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932 Jun 12 05:01:35 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:35 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bbf4abde-4977-4eec-9f11-4a547b0cb932" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-quobyte-bbf4abde-4977-4eec-9f11-4a547b0cb932" released by "delete_volume" :: held 1.288s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:35 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Created reservations ['c39f068a-2ed9-4763-bef3-acb7a5ac127c', 'd9244f60-47f7-41a5-8fc7-7ce921b87d16', 'a0d5732c-8ec3-42d0-91aa-334819207065', 'ae85327d-6ebb-4000-a45d-1bf010ff1dfa'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:36 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:01:36 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:36 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:01:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Deleted volume successfully. Jun 12 05:01:36 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-337f2ac6-ec7c-4545-85c7-229bf766b764 tempest-VolumesListTestJSON-731589426 None] Lock "cinder-bbf4abde-4977-4eec-9f11-4a547b0cb932-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Flow 'volume_create_manager' (eeafd70e-b064-4fc9-9235-999e87715f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09e9441-6c08-4d96-b320-6ca284e006af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09e9441-6c08-4d96-b320-6ca284e006af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1045489575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1105b162-77cb-497f-9dc0-6c39f848462c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3f35687d084c78b86e4595f67f77f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:39Z,use_quota=True,user_id='b03636b91d824d228e716373c5853ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba04bd87-f8d3-4e3c-bdba-adc58313a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba04bd87-f8d3-4e3c-bdba-adc58313a306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a2b9dc-68ef-4eb2-8a1a-5fb8fe6a1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a2b9dc-68ef-4eb2-8a1a-5fb8fe6a1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1105b162-77cb-497f-9dc0-6c39f848462c', 'volume_name': 'volume-1105b162-77cb-497f-9dc0-6c39f848462c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee8b963-e348-4716-9f2b-97486c21cbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee8b963-e348-4716-9f2b-97486c21cbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94552a4-9a05-4d8f-93f7-c77fe47d1714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:39 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Volume 1105b162-77cb-497f-9dc0-6c39f848462c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1105b162-77cb-497f-9dc0-6c39f848462c', 'volume_size': 1} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1045489575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1105b162-77cb-497f-9dc0-6c39f848462c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3f35687d084c78b86e4595f67f77f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:01:39Z,use_quota=True,user_id='b03636b91d824d228e716373c5853ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Creating volume 1105b162-77cb-497f-9dc0-6c39f848462c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:01:39 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:01:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:39 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c 1073741824 Jun 12 05:01:39 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:40 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c 1073741824" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:01:40 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c Jun 12 05:01:40 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:01:40 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c" returned: 0 in 0.581s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94552a4-9a05-4d8f-93f7-c77fe47d1714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1105b162-77cb-497f-9dc0-6c39f848462c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef73ec93-0c34-4009-af7a-15d45fbd6d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:01:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Volume volume-1105b162-77cb-497f-9dc0-6c39f848462c (1105b162-77cb-497f-9dc0-6c39f848462c): created successfully Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef73ec93-0c34-4009-af7a-15d45fbd6d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:01:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Flow 'volume_create_manager' (eeafd70e-b064-4fc9-9235-999e87715f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:01:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-03caebe0-224b-46ff-ab10-6a31619fe2d3 tempest-VolumesNegativeTest-1885801484 None] Created volume successfully. Jun 12 05:01:50 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:01:50 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=19,cinder:SELECT=7,cinder:DELETE=3,cinder:INSERT=4 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:02:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Acquiring lock "cinder-1105b162-77cb-497f-9dc0-6c39f848462c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Lock "cinder-1105b162-77cb-497f-9dc0-6c39f848462c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Acquiring lock "cinder-quobyte-1105b162-77cb-497f-9dc0-6c39f848462c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Lock "cinder-quobyte-1105b162-77cb-497f-9dc0-6c39f848462c" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc08f95-0692-4b13-9dda-da40e5ae88f7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:09 devstack sudo[109857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c Jun 12 05:02:09 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:10 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:10 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c Jun 12 05:02:10 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:10 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1105b162-77cb-497f-9dc0-6c39f848462c" returned: 0 in 0.609s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Lock "cinder-quobyte-1105b162-77cb-497f-9dc0-6c39f848462c" released by "delete_volume" :: held 1.325s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Created reservations ['9fc79e58-0608-4989-9c34-cdf503b0969e', 'a680db37-6aa1-4990-bd93-fb5f159b23c2', '840ab96d-20ae-48fa-a59f-5a25cac00bbe', 'fa6daf53-01e4-43c0-a95b-540be5f0eac6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:10 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:02:10 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:11 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.569s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:11 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:02:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Deleted volume successfully. Jun 12 05:02:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4ffb05e1-3a22-4c85-8cea-ebbbdd1c9087 tempest-VolumesNegativeTest-1885801484 None] Lock "cinder-1105b162-77cb-497f-9dc0-6c39f848462c-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:20 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=3 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:02:21 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (8a7f02bb-dd16-4773-85c4-c7618b62bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9339a071-6581-4d9e-bc71-9e6c6a0d036f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9339a071-6581-4d9e-bc71-9e6c6a0d036f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095868015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd200a10-ee7c-4d52-a241-722e7678f187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:22Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d78e6-27d0-4ab3-bd97-d1b1c3689dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d78e6-27d0-4ab3-bd97-d1b1c3689dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e668e1f-3396-4a28-ae5f-1d1ea654e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e668e1f-3396-4a28-ae5f-1d1ea654e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd200a10-ee7c-4d52-a241-722e7678f187', 'volume_name': 'volume-bd200a10-ee7c-4d52-a241-722e7678f187', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f71eec-7e82-487b-af80-7bf82612fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f71eec-7e82-487b-af80-7bf82612fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba44f313-4311-4bbd-8683-16395aae4ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:22 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Volume bd200a10-ee7c-4d52-a241-722e7678f187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd200a10-ee7c-4d52-a241-722e7678f187', 'volume_size': 1} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2095868015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd200a10-ee7c-4d52-a241-722e7678f187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:22Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Creating volume bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:02:22 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:02:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:22 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 1073741824 Jun 12 05:02:22 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:23 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 1073741824" returned: 0 in 0.735s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:23 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 Jun 12 05:02:23 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:23 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba44f313-4311-4bbd-8683-16395aae4ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd200a10-ee7c-4d52-a241-722e7678f187', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656eb231-ec04-4a1c-a7fb-6a69e4a17878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:23 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Volume volume-bd200a10-ee7c-4d52-a241-722e7678f187 (bd200a10-ee7c-4d52-a241-722e7678f187): created successfully Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656eb231-ec04-4a1c-a7fb-6a69e4a17878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:23 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (8a7f02bb-dd16-4773-85c4-c7618b62bc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-98b66654-bc25-497a-a70b-098cf7bd75dc tempest-VolumesSnapshotTestJSON-1424195109 None] Created volume successfully. Jun 12 05:02:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Creating offline snapshot bf2e0186-8611-4939-bdcd-b3d07f3db27a of volume bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:02:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9637413-2370-49aa-9cdf-2e1dfea5fb18]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:24 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 Jun 12 05:02:24 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:25 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187" returned: 0 in 0.715s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:25 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a 1G Jun 12 05:02:25 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:26 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a 1G" returned: 0 in 0.746s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd200a10-ee7c-4d52-a241-722e7678f187 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:26 devstack sudo[109899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd200a10-ee7c-4d52-a241-722e7678f187 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a Jun 12 05:02:26 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:26 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd200a10-ee7c-4d52-a241-722e7678f187 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a" returned: 0 in 0.662s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:26 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a is being set with open permissions: ugo+rw Jun 12 05:02:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:26 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a Jun 12 05:02:26 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:27 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:27 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info Jun 12 05:02:27 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:28 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:28 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info is being set with open permissions: ugo+rw Jun 12 05:02:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:28 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info Jun 12 05:02:28 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:28 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.info" returned: 0 in 0.576s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.941s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1ab2d67c-1073-47bd-a003-189427dead8f tempest-VolumesSnapshotTestJSON-1424195109 None] Create snapshot completed successfully Jun 12 05:02:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-bf2e0186-8611-4939-bdcd-b3d07f3db27a-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-bf2e0186-8611-4939-bdcd-b3d07f3db27a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-bd200a10-ee7c-4d52-a241-722e7678f187" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-bd200a10-ee7c-4d52-a241-722e7678f187" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-bf2e0186-8611-4939-bdcd-b3d07f3db27a" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-bf2e0186-8611-4939-bdcd-b3d07f3db27a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Deleting offline snapshot bf2e0186-8611-4939-bdcd-b3d07f3db27a of volume bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] snapshot_file for this snap is: volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6049388b-0561-49a1-978f-ba92ce780fc0]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:29 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a Jun 12 05:02:29 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:29 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a" returned: 0 in 0.697s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd200a10-ee7c-4d52-a241-722e7678f187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[318b9241-9cdb-4252-96f3-943e96aa741e]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:29 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 Jun 12 05:02:29 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:30 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187" returned: 0 in 0.688s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:30 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a Jun 12 05:02:30 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:31 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a" returned: 0 in 0.677s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:31 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a Jun 12 05:02:31 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:31 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187.bf2e0186-8611-4939-bdcd-b3d07f3db27a" returned: 0 in 0.579s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-bf2e0186-8611-4939-bdcd-b3d07f3db27a" released by "_delete_snapshot" :: held 2.757s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-bd200a10-ee7c-4d52-a241-722e7678f187" released by "delete_snapshot" :: held 2.780s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:31 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:02:31 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['1faff66a-ee82-4982-9ad1-a004f7d8cbe2', '643fe153-cea3-4201-a93e-6d6f8a9beb3b', 'e64502fe-eb7b-4f2a-a312-a04ae27d195d', 'b834aaca-b1f2-4a7e-8ebc-f0f66d2b64db'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:02:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Delete snapshot completed successfully. Jun 12 05:02:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-08d5bf52-ee53-451a-856a-4aa462815464 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-bf2e0186-8611-4939-bdcd-b3d07f3db27a-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:32 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.629s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (983950ad-677a-4aff-958e-78449794c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ff04ab-f1c8-4250-aa25-38e9dd46a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ff04ab-f1c8-4250-aa25-38e9dd46a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2031486269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183ecd2d-cb69-4d61-9d30-0374bd3ae86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:33Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52bfe2f-41db-493a-89c8-13deaade64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52bfe2f-41db-493a-89c8-13deaade64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a82fe3-b7c8-497d-8e42-14871620793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a82fe3-b7c8-497d-8e42-14871620793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183ecd2d-cb69-4d61-9d30-0374bd3ae86f', 'volume_name': 'volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebae4d26-553e-4cff-8f1a-0dc50bfe2df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebae4d26-553e-4cff-8f1a-0dc50bfe2df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54b1776-c731-4cd7-8134-decfcfc41033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Volume 183ecd2d-cb69-4d61-9d30-0374bd3ae86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f', 'volume_size': 1} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2031486269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183ecd2d-cb69-4d61-9d30-0374bd3ae86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:33Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Creating volume 183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:02:32 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:02:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:32 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f 1073741824 Jun 12 05:02:32 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:33 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f 1073741824" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:33 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:33 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:33 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.574s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:02:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54b1776-c731-4cd7-8134-decfcfc41033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c710bd-27e7-4b93-9239-15776db8c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Volume volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f (183ecd2d-cb69-4d61-9d30-0374bd3ae86f): created successfully Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c710bd-27e7-4b93-9239-15776db8c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (983950ad-677a-4aff-958e-78449794c802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9ba9ba9e-0ccd-4ccd-ac63-c252527f078e tempest-VolumesSnapshotTestJSON-1424195109 None] Created volume successfully. Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Creating offline snapshot d1157143-3040-4d3d-a7d6-3be0d1c3959c of volume 183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8055c4-d578-44c8-9ef9-f42d6526420c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:34 devstack sudo[109945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:34 devstack sudo[109945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:35 devstack sudo[109945]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:35 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c 1G Jun 12 05:02:35 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:36 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c 1G" returned: 0 in 0.709s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:36 devstack sudo[109955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c Jun 12 05:02:36 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:36 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c" returned: 0 in 0.632s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:36 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c is being set with open permissions: ugo+rw Jun 12 05:02:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:36 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c Jun 12 05:02:36 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:37 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c" returned: 0 in 0.567s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:37 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info Jun 12 05:02:37 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:38 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:38 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info is being set with open permissions: ugo+rw Jun 12 05:02:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:38 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info Jun 12 05:02:38 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:38 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.info" returned: 0 in 0.572s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.806s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-37f288db-1b39-4e0d-bf0e-54a598b0e51d tempest-VolumesSnapshotTestJSON-1424195109 None] Create snapshot completed successfully Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (e323850c-f2a5-4fa9-ab97-5b6ca5ecb3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ecb605-8128-4283-98fd-58f8234b9877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ecb605-8128-4283-98fd-58f8234b9877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-384285795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cfcbb2-7545-4eb3-87d2-9b5df8849014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d1157143-3040-4d3d-a7d6-3be0d1c3959c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:39Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fb1900-7b9b-4355-8cc5-5027086366a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fb1900-7b9b-4355-8cc5-5027086366a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e90d0af-94d3-47c6-969c-c760c8fd65c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e90d0af-94d3-47c6-969c-c760c8fd65c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7cfcbb2-7545-4eb3-87d2-9b5df8849014', 'volume_name': 'volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014', 'volume_size': 2, 'snapshot_id': 'd1157143-3040-4d3d-a7d6-3be0d1c3959c'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1fb0f8-d7fc-4c68-8190-248ed36b1e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1fb0f8-d7fc-4c68-8190-248ed36b1e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b9b788-e5e1-4a35-a41b-0b515464fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:39 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume f7cfcbb2-7545-4eb3-87d2-9b5df8849014: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014', 'volume_size': 2, 'snapshot_id': 'd1157143-3040-4d3d-a7d6-3be0d1c3959c'} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-d1157143-3040-4d3d-a7d6-3be0d1c3959c-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-d1157143-3040-4d3d-a7d6-3be0d1c3959c-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Creating volume f7cfcbb2-7545-4eb3-87d2-9b5df8849014 from snapshot d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] snapshot: d1157143-3040-4d3d-a7d6-3be0d1c3959c, volume: f7cfcbb2-7545-4eb3-87d2-9b5df8849014, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c6d463-2a00-45d8-bb44-d7752309c68f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:39 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c Jun 12 05:02:39 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:40 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c" returned: 0 in 0.688s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0bf94a-34fc-49ca-b96d-d4e6197b6ff8]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:40 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:40 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:40 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:02:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:40 devstack sudo[110015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 Jun 12 05:02:40 devstack sudo[110015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:45 devstack sudo[110015]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" returned: 0 in 4.237s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:45 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cbb14d-7769-467d-b1ee-ced16e0bc31c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:45 devstack sudo[110029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:45 devstack sudo[110029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:46 devstack sudo[110029]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.850s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:02:46 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Converted 1024.00 MB image at 241.62 MB/s Jun 12 05:02:46 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 is being set with open permissions: ugo+rw Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:46 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 Jun 12 05:02:46 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:46 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" released by "_copy_volume_from_snapshot" :: held 7.137s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-d1157143-3040-4d3d-a7d6-3be0d1c3959c-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" released by "_create_volume_from_snapshot" :: held 7.164s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.180s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b9b788-e5e1-4a35-a41b-0b515464fd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014', 'volume_size': 2, 'snapshot_id': 'd1157143-3040-4d3d-a7d6-3be0d1c3959c'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f4752e-b412-4bf2-b363-18308ba6e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:46 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 (f7cfcbb2-7545-4eb3-87d2-9b5df8849014): created successfully Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f4752e-b412-4bf2-b363-18308ba6e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (e323850c-f2a5-4fa9-ab97-5b6ca5ecb3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1d5a0b7f-ed2b-4720-ba44-5f947d6cfb92 tempest-VolumesSnapshotTestJSON-1424195109 None] Created volume successfully. Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-f7cfcbb2-7545-4eb3-87d2-9b5df8849014-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-f7cfcbb2-7545-4eb3-87d2-9b5df8849014-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce60538d-c075-4185-89e8-6076c415cc68]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:47 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 Jun 12 05:02:47 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:47 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:47 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014 Jun 12 05:02:47 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:48 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" returned: 0 in 0.608s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-f7cfcbb2-7545-4eb3-87d2-9b5df8849014" released by "delete_volume" :: held 1.328s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['ee97d792-1d7e-4c4b-b77e-71f3606a63ed', '0af676ea-4e71-4017-829b-d9c4858b73fd', '25e17dc9-e692-45e4-a0f3-bfbf11d83645', '5259e617-c0f7-4ddc-86a2-1ed7185afa1a'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:48 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:02:48 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:49 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.599s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:02:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Deleted volume successfully. Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-33699388-7583-454f-bdc5-f2f4fc0ef9e8 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-f7cfcbb2-7545-4eb3-87d2-9b5df8849014-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-d1157143-3040-4d3d-a7d6-3be0d1c3959c-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-d1157143-3040-4d3d-a7d6-3be0d1c3959c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-d1157143-3040-4d3d-a7d6-3be0d1c3959c" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-d1157143-3040-4d3d-a7d6-3be0d1c3959c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Deleting offline snapshot d1157143-3040-4d3d-a7d6-3be0d1c3959c of volume 183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] snapshot_file for this snap is: volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9a7385-3dae-4445-9de5-e40e0b79f555]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:49 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c Jun 12 05:02:49 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:50 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c" returned: 0 in 0.682s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:02:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b4487-1fb1-43f7-bd57-50d30c91bf70]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:50 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:50 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:50 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.726s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:50 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c Jun 12 05:02:50 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:51 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c" returned: 0 in 0.669s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:51 devstack sudo[110063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c Jun 12 05:02:51 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:52 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f.d1157143-3040-4d3d-a7d6-3be0d1c3959c" returned: 0 in 0.633s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-d1157143-3040-4d3d-a7d6-3be0d1c3959c" released by "_delete_snapshot" :: held 2.804s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" released by "delete_snapshot" :: held 2.827s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['d98f7ec8-1a94-4610-9de5-84cb689e21f5', '36315a1e-3ff3-4f98-9ce7-520f414303a2', '0b50c770-0f58-4938-b6bd-507d8c76175a', '1fce82d6-b816-479c-a786-af5cb4bf07d9'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:02:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Delete snapshot completed successfully. Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-6f2c6362-2c24-4971-9ba6-4209a5da1a47 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-d1157143-3040-4d3d-a7d6-3be0d1c3959c-delete_snapshot" released by "delete_snapshot" :: held 2.951s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-183ecd2d-cb69-4d61-9d30-0374bd3ae86f-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-183ecd2d-cb69-4d61-9d30-0374bd3ae86f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" acquired by "delete_volume" :: waited 0.012s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa62659-1dfe-4534-a781-e5d3a1da3f8b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:52 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:52 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:53 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.709s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:53 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f Jun 12 05:02:53 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:53 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" returned: 0 in 0.572s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-183ecd2d-cb69-4d61-9d30-0374bd3ae86f" released by "delete_volume" :: held 1.335s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['fd79f8f1-6451-4175-8b3a-7836d39a036f', 'e65a15db-7a43-4acf-b263-1e941f826612', '7b6617b2-4455-454a-b76d-cd3880a1caa6', '1d3b0d2f-1f21-45a0-851e-c6b7075bac16'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:53 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:54 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:54 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:02:54 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:54 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.570s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:54 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:02:54 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Deleted volume successfully. Jun 12 05:02:54 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-f0311c1a-305f-48f1-b247-15050a0d0a13 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-183ecd2d-cb69-4d61-9d30-0374bd3ae86f-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (fa22e371-ef5b-418e-8c91-bea00f040174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c771279-aa6e-45e2-aa9e-828124957214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c771279-aa6e-45e2-aa9e-828124957214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-319280592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0654130-b8af-475d-bc77-086edf2019e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:55Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae618dfa-7c75-4d42-a337-1d9dd9433030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae618dfa-7c75-4d42-a337-1d9dd9433030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41a9f73-5491-4ea7-86cd-fd0191e9efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41a9f73-5491-4ea7-86cd-fd0191e9efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0654130-b8af-475d-bc77-086edf2019e8', 'volume_name': 'volume-b0654130-b8af-475d-bc77-086edf2019e8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4812009-5073-42e2-a302-8f2685da2e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4812009-5073-42e2-a302-8f2685da2e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6648308b-be2e-4998-a0fb-958f703a5100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:55 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume b0654130-b8af-475d-bc77-086edf2019e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0654130-b8af-475d-bc77-086edf2019e8', 'volume_size': 1} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-319280592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0654130-b8af-475d-bc77-086edf2019e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:02:55Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Creating volume b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:02:55 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:55 devstack sudo[110078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 1073741824 Jun 12 05:02:55 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:55 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 1073741824" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:55 devstack sudo[110084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:02:55 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:56 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6648308b-be2e-4998-a0fb-958f703a5100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0654130-b8af-475d-bc77-086edf2019e8', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad5a5cf-2b25-4ac1-b932-6272eae3fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:02:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume volume-b0654130-b8af-475d-bc77-086edf2019e8 (b0654130-b8af-475d-bc77-086edf2019e8): created successfully Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad5a5cf-2b25-4ac1-b932-6272eae3fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:02:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (fa22e371-ef5b-418e-8c91-bea00f040174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:02:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-24d9030f-5dac-4171-98ab-d3c85a1b23e7 tempest-VolumesSnapshotTestJSON-1424195109 None] Created volume successfully. Jun 12 05:02:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:02:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:02:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Creating offline snapshot 4bb103d0-24a9-40db-abf9-a00534e579f7 of volume b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:02:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b147bd74-5b4b-472d-91e7-13a8cc858a67]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:02:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:57 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:02:57 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:58 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:58 devstack sudo[110092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 1G Jun 12 05:02:58 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:58 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 1G" returned: 0 in 0.727s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0654130-b8af-475d-bc77-086edf2019e8 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:58 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0654130-b8af-475d-bc77-086edf2019e8 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 Jun 12 05:02:58 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:59 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0654130-b8af-475d-bc77-086edf2019e8 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7" returned: 0 in 0.621s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:02:59 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 is being set with open permissions: ugo+rw Jun 12 05:02:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:02:59 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 Jun 12 05:02:59 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:02:59 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Jun 12 05:02:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7" returned: 0 in 0.569s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:00 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info Jun 12 05:03:00 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:00 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:00 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info is being set with open permissions: ugo+rw Jun 12 05:03:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:00 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info Jun 12 05:03:00 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:01 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.info" returned: 0 in 0.573s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.850s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:01 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-86239f76-b7da-4d3f-9f33-fa78cb96a10f tempest-VolumesSnapshotTestJSON-1424195109 None] Create snapshot completed successfully Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (4367c044-d2b8-45b4-ac62-de2cad87bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d972037-beec-4198-9dd8-afaf8a071499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d972037-beec-4198-9dd8-afaf8a071499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1768927263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12594a69-42dd-4ca8-958c-633293358d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b06832dcbff46ce9ab23b97ae1e2904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4bb103d0-24a9-40db-abf9-a00534e579f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:03:02Z,use_quota=True,user_id='4218766dc0d147e7a6b83cc1dfcccf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5021f4f5-44c2-4d93-88f2-1a191bccb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5021f4f5-44c2-4d93-88f2-1a191bccb194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09a075c-2bf8-4bc5-ba0f-1ecfb1c18b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09a075c-2bf8-4bc5-ba0f-1ecfb1c18b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12594a69-42dd-4ca8-958c-633293358d9d', 'volume_name': 'volume-12594a69-42dd-4ca8-958c-633293358d9d', 'volume_size': 1, 'snapshot_id': '4bb103d0-24a9-40db-abf9-a00534e579f7'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74c59d0-0021-43fb-bab2-8c427a32a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74c59d0-0021-43fb-bab2-8c427a32a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8906bcb-625f-468e-8fe1-fce394ebd0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume 12594a69-42dd-4ca8-958c-633293358d9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12594a69-42dd-4ca8-958c-633293358d9d', 'volume_size': 1, 'snapshot_id': '4bb103d0-24a9-40db-abf9-a00534e579f7'} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-4bb103d0-24a9-40db-abf9-a00534e579f7-12594a69-42dd-4ca8-958c-633293358d9d" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-4bb103d0-24a9-40db-abf9-a00534e579f7-12594a69-42dd-4ca8-958c-633293358d9d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Creating volume 12594a69-42dd-4ca8-958c-633293358d9d from snapshot 4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-12594a69-42dd-4ca8-958c-633293358d9d" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-12594a69-42dd-4ca8-958c-633293358d9d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] snapshot: 4bb103d0-24a9-40db-abf9-a00534e579f7, volume: 12594a69-42dd-4ca8-958c-633293358d9d, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d48a3f-b246-4024-87f7-3b24ff9985c6]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:02 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 Jun 12 05:03:02 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:02 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7" returned: 0 in 0.695s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0654130-b8af-475d-bc77-086edf2019e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f3ace-adeb-42f2-96a0-2dcf9829a14b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:02 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:03:02 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:03 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.671s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:03 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:03:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:03 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d Jun 12 05:03:03 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:07 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d" returned: 0 in 4.158s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:07 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd0f1e-bb5f-4dec-a2f2-5461b7e02521]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:07 devstack sudo[110135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:03:07 devstack sudo[110135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:08 devstack sudo[110135]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.874s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:08 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8, size 1024.00 MB, duration 4.16 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:03:08 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Converted 1024.00 MB image at 246.22 MB/s Jun 12 05:03:08 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d is being set with open permissions: ugo+rw Jun 12 05:03:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:08 devstack sudo[110140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d Jun 12 05:03:08 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:09 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d" returned: 0 in 0.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-12594a69-42dd-4ca8-958c-633293358d9d" released by "_copy_volume_from_snapshot" :: held 7.103s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-4bb103d0-24a9-40db-abf9-a00534e579f7-12594a69-42dd-4ca8-958c-633293358d9d" released by "_create_volume_from_snapshot" :: held 7.133s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.149s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8906bcb-625f-468e-8fe1-fce394ebd0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12594a69-42dd-4ca8-958c-633293358d9d', 'volume_size': 1, 'snapshot_id': '4bb103d0-24a9-40db-abf9-a00534e579f7'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832ac401-0f94-4ed4-ae0e-1b02e3174440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Volume volume-12594a69-42dd-4ca8-958c-633293358d9d (12594a69-42dd-4ca8-958c-633293358d9d): created successfully Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832ac401-0f94-4ed4-ae0e-1b02e3174440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Flow 'volume_create_manager' (4367c044-d2b8-45b4-ac62-de2cad87bd85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:03:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9fa913d9-c57f-4f2b-b13a-6a5ce59eef49 tempest-VolumesSnapshotTestJSON-1424195109 None] Created volume successfully. Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-12594a69-42dd-4ca8-958c-633293358d9d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-12594a69-42dd-4ca8-958c-633293358d9d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-12594a69-42dd-4ca8-958c-633293358d9d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-12594a69-42dd-4ca8-958c-633293358d9d" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f3702-d455-4238-9b9c-fa7f06728b79]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:09 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d Jun 12 05:03:09 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:10 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d" returned: 0 in 0.688s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:10 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d Jun 12 05:03:10 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:10 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-12594a69-42dd-4ca8-958c-633293358d9d" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:10 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-12594a69-42dd-4ca8-958c-633293358d9d" released by "delete_volume" :: held 1.304s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:10 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['2410c0c3-7dd9-406a-8b09-0769fc17ab02', '0639b81a-1dba-4cb2-8410-e4498d8e9b26', 'e943b782-75b9-4331-b1ff-3dc9c57474a4', '99c8f948-84d9-4ecd-b3fe-e8b3a4e4c560'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:11 devstack sudo[110151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:03:11 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:11 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.575s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:03:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Deleted volume successfully. Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-79607717-135e-465e-89bf-0f2eaa487c0c tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-12594a69-42dd-4ca8-958c-633293358d9d-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-4bb103d0-24a9-40db-abf9-a00534e579f7-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-4bb103d0-24a9-40db-abf9-a00534e579f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-b0654130-b8af-475d-bc77-086edf2019e8" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-b0654130-b8af-475d-bc77-086edf2019e8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-4bb103d0-24a9-40db-abf9-a00534e579f7" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-4bb103d0-24a9-40db-abf9-a00534e579f7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Deleting offline snapshot 4bb103d0-24a9-40db-abf9-a00534e579f7 of volume b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] snapshot_file for this snap is: volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[994aea68-6b04-4fcc-96e7-1ee08bd36498]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:12 devstack sudo[110154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 Jun 12 05:03:12 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:12 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0654130-b8af-475d-bc77-086edf2019e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:03:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2101d1-6b1d-454b-8048-02462bd9675d]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:12 devstack sudo[110159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:03:12 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:13 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.687s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:13 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 Jun 12 05:03:13 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:13 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7" returned: 0 in 0.686s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:14 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7 Jun 12 05:03:14 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:14 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8.4bb103d0-24a9-40db-abf9-a00534e579f7" returned: 0 in 0.586s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-4bb103d0-24a9-40db-abf9-a00534e579f7" released by "_delete_snapshot" :: held 2.744s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-b0654130-b8af-475d-bc77-086edf2019e8" released by "delete_snapshot" :: held 2.764s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['7a6aa4ac-9d5e-4909-a890-501badcabb60', 'b68c0608-4ddc-4c88-b6cb-093e24dfc977', 'd002558b-967a-4242-b287-018edb0efe44', 'd209d256-df6a-44cc-92a5-122530d4b1c3'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:03:14 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Delete snapshot completed successfully. Jun 12 05:03:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a51a42b0-c3f5-4881-923c-8ce926cdf52d tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-4bb103d0-24a9-40db-abf9-a00534e579f7-delete_snapshot" released by "delete_snapshot" :: held 2.876s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-b0654130-b8af-475d-bc77-086edf2019e8-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-b0654130-b8af-475d-bc77-086edf2019e8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-b0654130-b8af-475d-bc77-086edf2019e8" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-b0654130-b8af-475d-bc77-086edf2019e8" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b600b7d-0282-47b4-85fa-ef1a51b28ab7]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:15 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:03:15 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:15 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.702s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:15 devstack sudo[110178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8 Jun 12 05:03:15 devstack sudo[110178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:16 devstack sudo[110178]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b0654130-b8af-475d-bc77-086edf2019e8" returned: 0 in 0.592s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-b0654130-b8af-475d-bc77-086edf2019e8" released by "delete_volume" :: held 1.345s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['d91fb958-0412-41be-8382-30e27e6492bb', '0be3ef3a-8fe8-4b72-ad7d-f012b2cc0fde', 'de3059e6-ce10-4712-b4d9-32b0701f2213', '90e77e02-8b82-46ba-94b1-bc81f3e57b6b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:16 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:03:16 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:17 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:03:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Deleted volume successfully. Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1d6b8fb8-8cfe-4204-8f38-2cf18cfed9f1 tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-b0654130-b8af-475d-bc77-086edf2019e8-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-bd200a10-ee7c-4d52-a241-722e7678f187-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-bd200a10-ee7c-4d52-a241-722e7678f187-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "cinder-quobyte-bd200a10-ee7c-4d52-a241-722e7678f187" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-bd200a10-ee7c-4d52-a241-722e7678f187" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a995956d-e61e-4000-a8a4-54ff9de720a1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:03:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:17 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 Jun 12 05:03:17 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:18 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187" returned: 0 in 0.684s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:18 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187 Jun 12 05:03:18 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:18 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bd200a10-ee7c-4d52-a241-722e7678f187" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-quobyte-bd200a10-ee7c-4d52-a241-722e7678f187" released by "delete_volume" :: held 1.323s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Created reservations ['797bae90-2db7-42cd-a523-6af75b0f5f8e', 'e994bf69-865d-4de4-b9bd-bf0c78292c83', '3d386315-b4cd-4537-95ff-3cf0355e1f05', '8b9036cf-db35-4a6c-81e9-495590e9abf4'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:18 devstack sudo[110192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:03:18 devstack sudo[110192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:19 devstack sudo[110192]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.598s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:19 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:03:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Deleted volume successfully. Jun 12 05:03:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d0986301-1e0d-4bb4-b950-1fe45b21e8bd tempest-VolumesSnapshotTestJSON-1424195109 None] Lock "cinder-bd200a10-ee7c-4d52-a241-722e7678f187-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:03:28 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=73,cinder:SELECT=75,cinder:INSERT=20,cinder:DELETE=6 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:03:29 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=63,cinder:UPDATE=76,cinder:INSERT=18,cinder:DELETE=7 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:31 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:03:31 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:32 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.607s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:03:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:03:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:03:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Flow 'volume_create_manager' (29000e5d-b4bc-4ab9-ab1c-8c90bc620d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17db04b2-daad-4a49-9c67-4a484ea2613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17db04b2-daad-4a49-9c67-4a484ea2613e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-347674844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f57a093-d10f-4a93-b6a2-f61e67b66dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85616b518e4483f824065e03d80e523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:03:44Z,use_quota=True,user_id='a066f3657d36484d939e1bd3b61ea832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589f986b-d882-4d4f-a1b2-f08b74161fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589f986b-d882-4d4f-a1b2-f08b74161fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547cc068-1de6-420c-8ed8-721850b87efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547cc068-1de6-420c-8ed8-721850b87efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f57a093-d10f-4a93-b6a2-f61e67b66dc1', 'volume_name': 'volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612ba034-9a9d-4233-a238-6e3a63c3f41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612ba034-9a9d-4233-a238-6e3a63c3f41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15dfebe-f081-400b-afc2-56faaa012594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:44 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Volume 1f57a093-d10f-4a93-b6a2-f61e67b66dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1', 'volume_size': 1} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-347674844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f57a093-d10f-4a93-b6a2-f61e67b66dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85616b518e4483f824065e03d80e523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:03:44Z,use_quota=True,user_id='a066f3657d36484d939e1bd3b61ea832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Creating volume 1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:03:44 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:03:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:44 devstack sudo[110251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 1073741824 Jun 12 05:03:44 devstack sudo[110251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:45 devstack sudo[110251]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 1073741824" returned: 0 in 0.821s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:03:45 devstack sudo[110259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:03:45 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:03:45 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.631s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15dfebe-f081-400b-afc2-56faaa012594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fb0ae1-8dda-470d-8f7c-4f658134f15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:03:45 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Volume volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 (1f57a093-d10f-4a93-b6a2-f61e67b66dc1): created successfully Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fb0ae1-8dda-470d-8f7c-4f658134f15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:03:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Flow 'volume_create_manager' (29000e5d-b4bc-4ab9-ab1c-8c90bc620d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:03:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-399d3ca9-429d-477d-82db-16b5d5712919 tempest-TestStampPattern-380925897 None] Created volume successfully. Jun 12 05:03:55 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:03:55 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:04:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:04:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:04:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:04:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:04:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6baa4d-ff0d-4d5d-a401-c4139ed17103]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:04:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:24 devstack sudo[110382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:04:24 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:25 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.710s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.726s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:04:25 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6ad7f90-3cd6-43ec-bce5-3890123f3125', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 05:04:25 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-f8f54ae6-9f55-43c5-a376-6cabdf290283 req-52b05a2e-98f3-42a1-b986-c6fc842e39bc tempest-TestStampPattern-380925897 None] attachment_update completed successfully. Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:04:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:31 devstack sudo[110803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:04:31 devstack sudo[110803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:32 devstack sudo[110803]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:04:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:04:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:04:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:04:33 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-9d5169dd-b1fe-4d6f-aa79-9b5d39b5704f req-3c74ed31-b57f-4910-afdd-dd107ddd4091 tempest-TestStampPattern-380925897 None] Terminate volume connection completed successfully. Jun 12 05:04:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-9d5169dd-b1fe-4d6f-aa79-9b5d39b5704f req-3c74ed31-b57f-4910-afdd-dd107ddd4091 tempest-TestStampPattern-380925897 None] Deleting attachment a6ad7f90-3cd6-43ec-bce5-3890123f3125. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 05:04:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:04:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:04:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Creating offline snapshot 99890bbc-d405-49c5-82d7-34ab2bd635fc of volume 1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:04:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc3277-354b-4d52-a1df-36c960748c0a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:04:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:35 devstack sudo[110834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:04:35 devstack sudo[110834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:36 devstack sudo[110834]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.693s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:36 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc 1G Jun 12 05:04:36 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:36 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc 1G" returned: 0 in 0.730s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:36 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc Jun 12 05:04:36 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:37 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc" returned: 0 in 0.660s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:37 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc is being set with open permissions: ugo+rw Jun 12 05:04:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:37 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc Jun 12 05:04:37 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:38 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc" returned: 0 in 0.579s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:38 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info Jun 12 05:04:38 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:38 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:38 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info is being set with open permissions: ugo+rw Jun 12 05:04:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:38 devstack sudo[110891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info Jun 12 05:04:38 devstack sudo[110891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:39 devstack sudo[110891]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.info" returned: 0 in 0.582s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.900s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:04:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-79b23aef-2d78-4860-928c-caeb3450ae63 tempest-TestStampPattern-380925897 None] Create snapshot completed successfully Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Flow 'volume_create_manager' (c4819437-5006-4fed-8166-53422d5ebdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d486f30-1b6b-4fb9-823c-5d51ddf312b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d486f30-1b6b-4fb9-823c-5d51ddf312b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-451863709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f85616b518e4483f824065e03d80e523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99890bbc-d405-49c5-82d7-34ab2bd635fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:04:48Z,use_quota=True,user_id='a066f3657d36484d939e1bd3b61ea832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a368508-d8f0-4af9-9d27-3f9f12b359d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a368508-d8f0-4af9-9d27-3f9f12b359d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2387d88-df12-4ceb-a198-2492b0c1d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2387d88-df12-4ceb-a198-2492b0c1d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3', 'volume_name': 'volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3', 'volume_size': 1, 'snapshot_id': '99890bbc-d405-49c5-82d7-34ab2bd635fc'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6c8ef3-6d4c-4670-9af2-8800cce92585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6c8ef3-6d4c-4670-9af2-8800cce92585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761308cd-8822-40bc-aecd-908ee7ee8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:04:48 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Volume 4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3', 'volume_size': 1, 'snapshot_id': '99890bbc-d405-49c5-82d7-34ab2bd635fc'} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-quobyte-99890bbc-d405-49c5-82d7-34ab2bd635fc-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-99890bbc-d405-49c5-82d7-34ab2bd635fc-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Creating volume 4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 from snapshot 99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-quobyte-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] snapshot: 99890bbc-d405-49c5-82d7-34ab2bd635fc, volume: 4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3368f9-53e0-465a-8e11-99b1f90505cc]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:04:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:48 devstack sudo[110933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc Jun 12 05:04:48 devstack sudo[110933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:49 devstack sudo[110933]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc" returned: 0 in 0.734s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ba7a8-d975-4762-ac79-9c42f8e27a4c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:49 devstack sudo[110940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:04:49 devstack sudo[110940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:49 devstack sudo[110940]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.726s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:04:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:49 devstack sudo[110945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 Jun 12 05:04:49 devstack sudo[110945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:54 devstack sudo[110945]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" returned: 0 in 4.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabf0fa-9d79-4ec6-9e4f-37560387b64c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:04:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:54 devstack sudo[110959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:04:54 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:55 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.940s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:55 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:04:55 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Converted 1024.00 MB image at 218.84 MB/s Jun 12 05:04:55 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 is being set with open permissions: ugo+rw Jun 12 05:04:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:04:55 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 Jun 12 05:04:55 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:04:56 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" returned: 0 in 0.648s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" released by "_copy_volume_from_snapshot" :: held 7.853s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-99890bbc-d405-49c5-82d7-34ab2bd635fc-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" released by "_create_volume_from_snapshot" :: held 7.893s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.916s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761308cd-8822-40bc-aecd-908ee7ee8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3', 'volume_size': 1, 'snapshot_id': '99890bbc-d405-49c5-82d7-34ab2bd635fc'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787e3e06-ace0-47f1-adad-5baeae8ef8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:04:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Volume volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 (4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3): created successfully Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787e3e06-ace0-47f1-adad-5baeae8ef8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:04:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Flow 'volume_create_manager' (c4819437-5006-4fed-8166-53422d5ebdbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:04:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-eb6a7014-9b60-4b55-80fd-8adcfec4505a tempest-TestStampPattern-380925897 None] Created volume successfully. Jun 12 05:05:06 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:05:06 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbaee9f-3129-4665-ac10-63c9e261a946]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:31 devstack sudo[111093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 Jun 12 05:05:31 devstack sudo[111093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:05:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:31 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:05:31 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:32 devstack sudo[111093]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" returned: 0 in 0.695s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.717s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52', 'name': 'volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '040f76ed-7133-4879-b85f-1b0446e21b83', 'enforce_multipath': True} {{(pid=92320) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jun 12 05:05:32 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:05:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:05:32 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-4229ea64-3f77-40ca-b944-4928bfb19ec0 req-b75df65b-fadc-4d6a-8d52-e8031f6291d3 tempest-TestStampPattern-380925897 None] attachment_update completed successfully. Jun 12 05:05:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [req-9af8923b-f10e-4bc8-bc66-f80543535b89 req-d142f5a4-8f44-45a4-adb0-db8b40c916ca tempest-TestStampPattern-380925897 None] Terminate volume connection completed successfully. Jun 12 05:05:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [req-9af8923b-f10e-4bc8-bc66-f80543535b89 req-d142f5a4-8f44-45a4-adb0-db8b40c916ca tempest-TestStampPattern-380925897 None] Deleting attachment 040f76ed-7133-4879-b85f-1b0446e21b83. {{(pid=92320) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jun 12 05:05:42 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:05:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:05:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Lock "cinder-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:05:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-quobyte-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:05:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:05:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d236dbb-cb37-486b-937f-dc3a2e816cdc]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:05:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:47 devstack sudo[111604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 Jun 12 05:05:47 devstack sudo[111604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:48 devstack sudo[111604]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" returned: 0 in 0.686s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:48 devstack sudo[111609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3 Jun 12 05:05:48 devstack sudo[111609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:49 devstack sudo[111609]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" returned: 0 in 0.571s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3" released by "delete_volume" :: held 1.293s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Created reservations ['6af54341-5997-451a-9294-5f865e917554', '8512db44-a5fa-48f8-988d-8d9c31b23d1d', '6a4b97d7-68de-4498-b50b-507f090aee6a', 'a29e9031-b82e-438f-bcb0-e328fdb8c36a'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:49 devstack sudo[111612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:05:49 devstack sudo[111612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:49 devstack sudo[111612]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:05:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Deleted volume successfully. Jun 12 05:05:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9d55a11b-a442-4d5b-9ac9-28baeccd745c tempest-TestStampPattern-380925897 None] Lock "cinder-4bfe5569-1361-4ad5-9a5f-4ad9f65ff2e3-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-99890bbc-d405-49c5-82d7-34ab2bd635fc-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Lock "cinder-99890bbc-d405-49c5-82d7-34ab2bd635fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-quobyte-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-quobyte-99890bbc-d405-49c5-82d7-34ab2bd635fc" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-99890bbc-d405-49c5-82d7-34ab2bd635fc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Deleting offline snapshot 99890bbc-d405-49c5-82d7-34ab2bd635fc of volume 1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] snapshot_file for this snap is: volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7c88a7-9668-462e-9d56-f62778bcb508]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:50 devstack sudo[111615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc Jun 12 05:05:50 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:50 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc" returned: 0 in 0.673s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[50563e26-85c9-46b9-a3e5-e931626ea858]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:05:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:51 devstack sudo[111620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:05:51 devstack sudo[111620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:51 devstack sudo[111620]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.674s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:51 devstack sudo[111625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc Jun 12 05:05:51 devstack sudo[111625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:52 devstack sudo[111625]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc" returned: 0 in 0.652s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:05:52 devstack sudo[111630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc Jun 12 05:05:52 devstack sudo[111630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:05:52 devstack sudo[111630]: pam_unix(sudo:session): session closed for user root Jun 12 05:05:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1.99890bbc-d405-49c5-82d7-34ab2bd635fc" returned: 0 in 0.572s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:05:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-99890bbc-d405-49c5-82d7-34ab2bd635fc" released by "_delete_snapshot" :: held 2.662s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:05:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" released by "delete_snapshot" :: held 2.683s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:05:52 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Created reservations ['3fbbfe9e-d2a6-4d85-af37-a11aa097e513', '9a878520-f4fe-49ed-917b-c99b17d7e44c', '5b5e1242-5b2c-492c-ab7d-261ceb9ae44d', '7890c9df-8abd-4a7f-bcd1-ed1a67334c3c'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:05:53 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Delete snapshot completed successfully. Jun 12 05:05:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-fee1e03b-fc24-405a-b1ab-5e2d348a6272 tempest-TestStampPattern-380925897 None] Lock "cinder-99890bbc-d405-49c5-82d7-34ab2bd635fc-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-1f57a093-d10f-4a93-b6a2-f61e67b66dc1-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Lock "cinder-1f57a093-d10f-4a93-b6a2-f61e67b66dc1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Acquiring lock "cinder-quobyte-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5871c1-d066-404c-b61b-38ab2c0ede73]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:00 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:06:00 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:00 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.662s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:00 devstack sudo[111685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1 Jun 12 05:06:00 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:01 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" returned: 0 in 0.573s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Lock "cinder-quobyte-1f57a093-d10f-4a93-b6a2-f61e67b66dc1" released by "delete_volume" :: held 1.291s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Created reservations ['a86c019b-ee6d-4536-9b83-e746d0164b8a', '0fcd4a79-cfde-49f4-9e65-aa804ba164cb', 'cf10610c-807d-4cf2-8ab1-a8f58d8404a1', 'df4d58d3-775a-4cf1-ac55-1d5499c1545b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:01 devstack sudo[111688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:01 devstack sudo[111688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:02 devstack sudo[111688]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.587s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:02 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Deleted volume successfully. Jun 12 05:06:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-aef92db7-6566-4905-b808-0184e587b54a tempest-TestStampPattern-380925897 None] Lock "cinder-1f57a093-d10f-4a93-b6a2-f61e67b66dc1-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:06:13 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Flow 'volume_create_manager' (4b73562b-b6cf-4a51-8cfd-7bab6a96ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c795fa-8f9e-462d-a183-0010553ca039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c795fa-8f9e-462d-a183-0010553ca039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ad279-3c6b-4477-8541-7d5cb1284ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7075082abcc4e0082d18fbc6a598c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:14Z,use_quota=True,user_id='bddf8041b4a04fe2a5e5c38468827c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(130b2f79-70cf-4d50-9d4a-4ffa5530259d),volume_type_id=130b2f79-70cf-4d50-9d4a-4ffa5530259d)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323b26bf-08fe-402e-addd-058a72e7f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323b26bf-08fe-402e-addd-058a72e7f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3818c940-322d-4482-bcb9-c84097611d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3818c940-322d-4482-bcb9-c84097611d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '745ad279-3c6b-4477-8541-7d5cb1284ec0', 'volume_name': 'volume-745ad279-3c6b-4477-8541-7d5cb1284ec0', 'volume_size': 1, 'image_id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cce069e8-80da-4869-9c9e-626c445b52ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9d17e4360ffca34db163d121a5535ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7075082abcc4e0082d18fbc6a598c7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dbb23767227aca7653f6a61c95fa7a0f3c35c45d41663cfa59d23de3febf297eea099fb34c72afde00d4398b0c76365a95f01d6e057ee8da391081039f649d4b', 'id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'created_at': datetime.datetime(2026, 6, 12, 3, 6, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cce069e8-80da-4869-9c9e-626c445b52ee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ada030-98c2-4479-902d-259e50fe28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ada030-98c2-4479-902d-259e50fe28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930a2a2e-d2c3-43ce-a60c-3ef3557a5198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:14 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Volume 745ad279-3c6b-4477-8541-7d5cb1284ec0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-745ad279-3c6b-4477-8541-7d5cb1284ec0', 'volume_size': 1, 'image_id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cce069e8-80da-4869-9c9e-626c445b52ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9d17e4360ffca34db163d121a5535ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7075082abcc4e0082d18fbc6a598c7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dbb23767227aca7653f6a61c95fa7a0f3c35c45d41663cfa59d23de3febf297eea099fb34c72afde00d4398b0c76365a95f01d6e057ee8da391081039f649d4b', 'id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'created_at': datetime.datetime(2026, 6, 12, 3, 6, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cce069e8-80da-4869-9c9e-626c445b52ee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Trying to clone 745ad279-3c6b-4477-8541-7d5cb1284ec0 from image cce069e8-80da-4869-9c9e-626c445b52ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/cce069e8-80da-4869-9c9e-626c445b52ee', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 05:06:14 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Image download 0.00 MB at 0.00 MB/s Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cbd5f2-9bd7-40a3-924c-70865e3185b9]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:14 devstack sudo[111698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD Jun 12 05:06:14 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:15 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:15 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD Jun 12 05:06:15 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:16 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD" returned: 1 in 0.640s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Temporary image cce069e8-80da-4869-9c9e-626c445b52ee is fetched for user bddf8041b4a04fe2a5e5c38468827c62. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e4e369-977e-42c8-baf2-c7b05415f7b3]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:16 devstack sudo[111707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD Jun 12 05:06:16 devstack sudo[111707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:16 devstack sudo[111707]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:16 devstack sudo[111711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD Jun 12 05:06:16 devstack sudo[111711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:17 devstack sudo[111711]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD" returned: 1 in 0.641s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ad279-3c6b-4477-8541-7d5cb1284ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7075082abcc4e0082d18fbc6a598c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:14Z,use_quota=True,user_id='bddf8041b4a04fe2a5e5c38468827c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(130b2f79-70cf-4d50-9d4a-4ffa5530259d),volume_type_id=130b2f79-70cf-4d50-9d4a-4ffa5530259d)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Creating volume 745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:06:17 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:06:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:17 devstack sudo[111716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 1073741824 Jun 12 05:06:17 devstack sudo[111716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:18 devstack sudo[111716]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 1073741824" returned: 0 in 0.719s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:18 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:18 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:18 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 0 in 0.564s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Attempting download of cce069e8-80da-4869-9c9e-626c445b52ee ((None, [{'url': 'file:///opt/stack/data/glance/images/cce069e8-80da-4869-9c9e-626c445b52ee', 'metadata': {}}])) to volume 745ad279-3c6b-4477-8541-7d5cb1284ec0. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1db6f8-9713-4377-9501-bb6eccbffd0f]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:18 devstack sudo[111724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra Jun 12 05:06:18 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:19 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra" returned: 0 in 0.635s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:19 devstack sudo[111734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra Jun 12 05:06:19 devstack sudo[111734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:20 devstack sudo[111734]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra" returned: 1 in 0.633s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cce069e8-80da-4869-9c9e-626c445b52ee_g9vyh9ra' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:06:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[49684591-4b4d-4300-ae21-5a6c3ab1dd11]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:20 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD Jun 12 05:06:20 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:20 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:20 devstack sudo[111742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD Jun 12 05:06:20 devstack sudo[111742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:21 devstack sudo[111742]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD" returned: 1 in 0.653s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:06:21 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] cce069e8-80da-4869-9c9e-626c445b52ee was raw, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 05:06:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:21 devstack sudo[111747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:21 devstack sudo[111747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:22 devstack sudo[111747]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 0 in 0.642s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:22 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cce069e8-80da-4869-9c9e-626c445b52ee_oxbg2lrndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:06:22 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Converted 0.00 MB image at 0.00 MB/s Jun 12 05:06:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:22 devstack sudo[111752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 1G Jun 12 05:06:22 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:22 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 1G" returned: 0 in 0.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb959545-4fd8-42a2-a299-c9919b2236fc]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:22 devstack sudo[111757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:22 devstack sudo[111757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:23 devstack sudo[111757]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:23 devstack sudo[111762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:23 devstack sudo[111762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:24 devstack sudo[111762]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 1 in 0.665s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Downloaded image cce069e8-80da-4869-9c9e-626c445b52ee ((None, [{'url': 'file:///opt/stack/data/glance/images/cce069e8-80da-4869-9c9e-626c445b52ee', 'metadata': {}}])) to volume 745ad279-3c6b-4477-8541-7d5cb1284ec0 successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Temporary image cce069e8-80da-4869-9c9e-626c445b52ee for user bddf8041b4a04fe2a5e5c38468827c62 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Marking volume 745ad279-3c6b-4477-8541-7d5cb1284ec0 as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Copying metadata from image cce069e8-80da-4869-9c9e-626c445b52ee to 745ad279-3c6b-4477-8541-7d5cb1284ec0. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Creating volume glance metadata for volume 745ad279-3c6b-4477-8541-7d5cb1284ec0 backed by image cce069e8-80da-4869-9c9e-626c445b52ee with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a9d17e4360ffca34db163d121a5535ec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930a2a2e-d2c3-43ce-a60c-3ef3557a5198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745ad279-3c6b-4477-8541-7d5cb1284ec0', 'volume_size': 1, 'image_id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cce069e8-80da-4869-9c9e-626c445b52ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9d17e4360ffca34db163d121a5535ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a7075082abcc4e0082d18fbc6a598c7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dbb23767227aca7653f6a61c95fa7a0f3c35c45d41663cfa59d23de3febf297eea099fb34c72afde00d4398b0c76365a95f01d6e057ee8da391081039f649d4b', 'id': 'cce069e8-80da-4869-9c9e-626c445b52ee', 'created_at': datetime.datetime(2026, 6, 12, 3, 6, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cce069e8-80da-4869-9c9e-626c445b52ee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844ee743-c50c-4411-954d-96d1ea241d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:24 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Volume volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 (745ad279-3c6b-4477-8541-7d5cb1284ec0): created successfully Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844ee743-c50c-4411-954d-96d1ea241d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Flow 'volume_create_manager' (4b73562b-b6cf-4a51-8cfd-7bab6a96ef63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-95da11c7-6185-4205-b070-c8a115419757 tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Created volume successfully. Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Acquiring lock "cinder-745ad279-3c6b-4477-8541-7d5cb1284ec0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "cinder-745ad279-3c6b-4477-8541-7d5cb1284ec0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Acquiring lock "cinder-quobyte-745ad279-3c6b-4477-8541-7d5cb1284ec0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "cinder-quobyte-745ad279-3c6b-4477-8541-7d5cb1284ec0" acquired by "delete_volume" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:25 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7598d48-f388-4bcf-96ec-d3968de8193f]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:25 devstack sudo[111767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:25 devstack sudo[111767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:25 devstack sudo[111767]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 0 in 0.672s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:25 devstack sudo[111771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:25 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:26 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 1 in 0.663s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:06:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:26 devstack sudo[111777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0 Jun 12 05:06:26 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:26 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-745ad279-3c6b-4477-8541-7d5cb1284ec0" returned: 0 in 0.561s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "cinder-quobyte-745ad279-3c6b-4477-8541-7d5cb1284ec0" released by "delete_volume" :: held 1.952s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:26 devstack cinder-volume[92320]: WARNING cinder.quota [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 12 05:06:26 devstack cinder-volume[92320]: WARNING cinder.quota [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Created reservations ['6f41389b-9a99-4cb5-bf73-2020a37a7772', '88479572-3a95-4214-be2c-f3b688b609e6', '6f36e1ba-afff-4afc-ae5c-c728a0fb37d2', '0e2eaede-8ab4-4398-a424-a67d36627c64'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:27 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:27 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:27 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.616s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Deleted volume successfully. Jun 12 05:06:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7e9eb6cb-d9c4-4abf-8302-351ec10c0f2d tempest-VolumeAndVolumeTypeFromImageTest-971728793 None] Lock "cinder-745ad279-3c6b-4477-8541-7d5cb1284ec0-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (00fabf27-07e9-4c6f-8390-a0cbf17f5517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f82c5a6-91fe-4570-8fc2-af43878e9243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f82c5a6-91fe-4570-8fc2-af43878e9243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532036297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55930aa5-7ddb-43ae-9122-4048fe5b43ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:31Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ad6b2-71d1-471a-b25e-1a7adabc1bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ad6b2-71d1-471a-b25e-1a7adabc1bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712202a7-b231-4d7b-bbeb-f82b15bdef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712202a7-b231-4d7b-bbeb-f82b15bdef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55930aa5-7ddb-43ae-9122-4048fe5b43ce', 'volume_name': 'volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e33836-de76-4e35-9768-2d4a906ba514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e33836-de76-4e35-9768-2d4a906ba514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401b2714-c4a4-4ec4-a08f-11fde39b39fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:30 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Volume 55930aa5-7ddb-43ae-9122-4048fe5b43ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce', 'volume_size': 1} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532036297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55930aa5-7ddb-43ae-9122-4048fe5b43ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:31Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Creating volume 55930aa5-7ddb-43ae-9122-4048fe5b43ce {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:06:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:06:31 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:31 devstack sudo[111786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce 1073741824 Jun 12 05:06:31 devstack sudo[111786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (528b4698-0e7c-497f-9882-a5b60edf8540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adbd7ec-229f-4b13-b9aa-1de2d34111b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adbd7ec-229f-4b13-b9aa-1de2d34111b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-132602132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6608810-2331-4308-a090-ee86f49cb9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:31Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d985d44-73fa-48da-9b86-4c109ce15ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d985d44-73fa-48da-9b86-4c109ce15ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b92727d-40d5-4989-9ec0-c8a9c4b437e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b92727d-40d5-4989-9ec0-c8a9c4b437e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6608810-2331-4308-a090-ee86f49cb9eb', 'volume_name': 'volume-e6608810-2331-4308-a090-ee86f49cb9eb', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36ba1af-6ece-4406-bae5-af29dce92022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36ba1af-6ece-4406-bae5-af29dce92022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e982db77-d95a-4f4d-8466-5e8957f97d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Volume e6608810-2331-4308-a090-ee86f49cb9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6608810-2331-4308-a090-ee86f49cb9eb', 'volume_size': 1} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (ddea6444-61ae-4d22-98bc-cc8dc9665131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6b2b4d-1358-4c8f-b8ad-6fd131bf8f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6b2b4d-1358-4c8f-b8ad-6fd131bf8f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1416195074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072cac8e-67b8-4cf7-b0e2-bd444d1f18bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:32Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2111fc97-c36e-492f-93b8-f49892bbd41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2111fc97-c36e-492f-93b8-f49892bbd41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce94f4a2-79ad-4cd1-8152-b1291e6c72cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce94f4a2-79ad-4cd1-8152-b1291e6c72cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072cac8e-67b8-4cf7-b0e2-bd444d1f18bf', 'volume_name': 'volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21106183-1d79-4cf8-aefd-22d41dcaf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21106183-1d79-4cf8-aefd-22d41dcaf490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c1674f-bcc4-4bba-bbe7-1c82b66e7429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:31 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Volume 072cac8e-67b8-4cf7-b0e2-bd444d1f18bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf', 'volume_size': 1} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:31 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:31 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:31 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (f93fb016-2076-44f0-84e4-970dda1982c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10766e30-3199-41ec-9f51-c91ca3e7d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10766e30-3199-41ec-9f51-c91ca3e7d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2028794299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:32Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b83240b-b371-4137-8de7-e1669a461ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b83240b-b371-4137-8de7-e1669a461ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2cdb60-8978-4b64-81b9-3a47f8f1e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2cdb60-8978-4b64-81b9-3a47f8f1e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198', 'volume_name': 'volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6b52a-7b00-4044-a75f-ed926af8dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6b52a-7b00-4044-a75f-ed926af8dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71082cb-51a5-49e3-a7e0-12a8889919a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Volume a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198', 'volume_size': 1} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:32 devstack sudo[111786]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce 1073741824" returned: 0 in 1.083s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:32 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce Jun 12 05:06:32 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (8a04d401-afe4-4f4c-909b-95ca6f1a0aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dae6613-39c0-442c-be1e-9c97f71eb03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dae6613-39c0-442c-be1e-9c97f71eb03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277368295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2139146a-6447-4112-b898-581fbdbda64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:32Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7a95e3-8068-4cc2-909e-edf546d3c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7a95e3-8068-4cc2-909e-edf546d3c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019af2eb-1782-4ada-ad4f-3cf6677ff056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019af2eb-1782-4ada-ad4f-3cf6677ff056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2139146a-6447-4112-b898-581fbdbda64c', 'volume_name': 'volume-2139146a-6447-4112-b898-581fbdbda64c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9597be5-41b4-4d77-9ebd-c911dd43c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9597be5-41b4-4d77-9ebd-c911dd43c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bf461c-ac93-4095-a0c5-b13beffc0c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Volume 2139146a-6447-4112-b898-581fbdbda64c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2139146a-6447-4112-b898-581fbdbda64c', 'volume_size': 1} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.728s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:06:32 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce" returned: 0 in 0.624s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-132602132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6608810-2331-4308-a090-ee86f49cb9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:31Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Creating volume e6608810-2331-4308-a090-ee86f49cb9eb {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:06:32 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:32 devstack sudo[111800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb 1073741824 Jun 12 05:06:32 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401b2714-c4a4-4ec4-a08f-11fde39b39fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5189a3ca-a62d-468d-8c27-0a74ce4242ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:32 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Volume volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce (55930aa5-7ddb-43ae-9122-4048fe5b43ce): created successfully Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5189a3ca-a62d-468d-8c27-0a74ce4242ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (00fabf27-07e9-4c6f-8390-a0cbf17f5517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:32 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0ee7cd61-d5d6-4830-b3e9-6a2dcd814392 tempest-CreateVolumesFromImageTest-1706168744 None] Created volume successfully. Jun 12 05:06:33 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb 1073741824" returned: 0 in 0.792s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:33 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb Jun 12 05:06:33 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:34 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1416195074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072cac8e-67b8-4cf7-b0e2-bd444d1f18bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:32Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Creating volume 072cac8e-67b8-4cf7-b0e2-bd444d1f18bf {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:06:34 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e982db77-d95a-4f4d-8466-5e8957f97d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6608810-2331-4308-a090-ee86f49cb9eb', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:34 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf 1073741824 Jun 12 05:06:34 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee39513-6106-42a7-8d52-5bc3b2d56c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:34 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Volume volume-e6608810-2331-4308-a090-ee86f49cb9eb (e6608810-2331-4308-a090-ee86f49cb9eb): created successfully Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee39513-6106-42a7-8d52-5bc3b2d56c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (528b4698-0e7c-497f-9882-a5b60edf8540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cd4553e3-f00d-4a72-9432-7f443f2130c4 tempest-CreateVolumesFromImageTest-1706168744 None] Created volume successfully. Jun 12 05:06:34 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf 1073741824" returned: 0 in 0.746s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:34 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf Jun 12 05:06:34 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:35 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.461s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2028794299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:32Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Creating volume a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:06:35 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:35 devstack sudo[111819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 1073741824 Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c1674f-bcc4-4bba-bbe7-1c82b66e7429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:35 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a46ff4-8b8d-42be-9907-b3769dade0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Volume volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf (072cac8e-67b8-4cf7-b0e2-bd444d1f18bf): created successfully Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a46ff4-8b8d-42be-9907-b3769dade0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (ddea6444-61ae-4d22-98bc-cc8dc9665131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:35 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9f93312c-14ab-418a-bb92-2748622a7fb2 tempest-CreateVolumesFromImageTest-1706168744 None] Created volume successfully. Jun 12 05:06:36 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 1073741824" returned: 0 in 0.757s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:36 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 Jun 12 05:06:36 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:36 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198" returned: 0 in 0.585s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.413s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277368295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2139146a-6447-4112-b898-581fbdbda64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f623bf11c64117bf430a93af6e7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:06:32Z,use_quota=True,user_id='c3e71dc0fb0d4885a5017bef39604ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Creating volume 2139146a-6447-4112-b898-581fbdbda64c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:06:36 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71082cb-51a5-49e3-a7e0-12a8889919a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:36 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c 1073741824 Jun 12 05:06:36 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce9103b-4695-491e-999a-cb27be5e15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Volume volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 (a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198): created successfully Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce9103b-4695-491e-999a-cb27be5e15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (f93fb016-2076-44f0-84e4-970dda1982c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:36 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f9ace234-3c4c-4f5b-b4c3-bef01e143bd7 tempest-CreateVolumesFromImageTest-1706168744 None] Created volume successfully. Jun 12 05:06:37 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c 1073741824" returned: 0 in 0.752s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:37 devstack sudo[111833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c Jun 12 05:06:37 devstack sudo[111833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:38 devstack sudo[111833]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c" returned: 0 in 0.620s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bf461c-ac93-4095-a0c5-b13beffc0c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2139146a-6447-4112-b898-581fbdbda64c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebcce1c-73e6-43d5-977c-3b897ffd22c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:06:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Volume volume-2139146a-6447-4112-b898-581fbdbda64c (2139146a-6447-4112-b898-581fbdbda64c): created successfully Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebcce1c-73e6-43d5-977c-3b897ffd22c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Flow 'volume_create_manager' (8a04d401-afe4-4f4c-909b-95ca6f1a0aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:06:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-737957e5-3369-4dbf-86a6-1dcfdafbc205 tempest-CreateVolumesFromImageTest-1706168744 None] Created volume successfully. Jun 12 05:06:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-2139146a-6447-4112-b898-581fbdbda64c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-2139146a-6447-4112-b898-581fbdbda64c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-quobyte-2139146a-6447-4112-b898-581fbdbda64c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-2139146a-6447-4112-b898-581fbdbda64c" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21602ff-5d09-4507-a113-deee6a5d82dd]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:39 devstack sudo[111872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c Jun 12 05:06:39 devstack sudo[111872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:39 devstack sudo[111872]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c" returned: 0 in 0.691s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:39 devstack sudo[111877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c Jun 12 05:06:39 devstack sudo[111877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:40 devstack sudo[111877]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-2139146a-6447-4112-b898-581fbdbda64c" returned: 0 in 0.560s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-2139146a-6447-4112-b898-581fbdbda64c" released by "delete_volume" :: held 1.288s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Created reservations ['5a04b119-8a8c-4266-a99d-f26ae119cd49', 'dc01dcc9-dfbb-4a97-863a-28a6c93ed6d5', 'b57146b2-c622-41a9-86f9-caa7dff612a3', '2ef5e04b-7723-4d77-8520-5cc7707daae0'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:40 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:40 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:41 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.565s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:41 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Deleted volume successfully. Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-710688e5-4846-4465-af22-cb803611fc18 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-2139146a-6447-4112-b898-581fbdbda64c-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-quobyte-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[498541aa-b6a2-45bd-9018-1e1e046cb551]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:41 devstack sudo[111883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 Jun 12 05:06:41 devstack sudo[111883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:41 devstack sudo[111883]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:41 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198 Jun 12 05:06:41 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:42 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198" returned: 0 in 0.580s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198" released by "delete_volume" :: held 1.300s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Created reservations ['af514dbf-3a14-4bb1-9b30-39e4e5dbc5fb', 'b64b2112-454d-43e4-8569-7dbe55af1975', 'e3f9d0e3-b5ac-4027-8642-278d04c96eaf', '0ac47fb9-3364-4e9c-b8eb-55cdf5ee247e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:42 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:42 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:43 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.591s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Deleted volume successfully. Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c50fef8e-09e6-492e-ae84-afd9dea3538f tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-a8ce8d87-a4d1-46da-b7c4-f1d5cebb1198-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-quobyte-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf" acquired by "delete_volume" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8324c-a7e9-4c1e-919e-bce4f3365011]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:43 devstack sudo[111895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf Jun 12 05:06:43 devstack sudo[111895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:44 devstack sudo[111895]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:44 devstack sudo[111900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf Jun 12 05:06:44 devstack sudo[111900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:44 devstack sudo[111900]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf" returned: 0 in 0.568s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf" released by "delete_volume" :: held 1.287s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Created reservations ['e07e78a0-5135-48eb-8706-f27f857e5682', '7171eb4d-520e-4737-bcae-7f7c407ef283', '359852ab-1eae-439b-9a89-0830aba74acc', '574025b9-af82-43b3-9001-829535dcaf5e'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:44 devstack sudo[111903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:44 devstack sudo[111903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:45 devstack sudo[111903]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.563s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Deleted volume successfully. Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-0ac5034e-ffce-419e-9f7f-12937ee98a11 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-072cac8e-67b8-4cf7-b0e2-bd444d1f18bf-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-e6608810-2331-4308-a090-ee86f49cb9eb-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-e6608810-2331-4308-a090-ee86f49cb9eb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-quobyte-e6608810-2331-4308-a090-ee86f49cb9eb" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-e6608810-2331-4308-a090-ee86f49cb9eb" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f62c49-58f8-4901-a82e-cf8555a94688]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:45 devstack sudo[111906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb Jun 12 05:06:45 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:46 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb" returned: 0 in 0.667s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:46 devstack sudo[111911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb Jun 12 05:06:46 devstack sudo[111911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:46 devstack sudo[111911]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-e6608810-2331-4308-a090-ee86f49cb9eb" returned: 0 in 0.571s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:46 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-e6608810-2331-4308-a090-ee86f49cb9eb" released by "delete_volume" :: held 1.277s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Created reservations ['9826b98c-ca26-4e5c-9c9f-a565fba0eef2', '96580e97-9645-4e2d-9add-502fb1ffd2c7', '50317a76-36e3-4aaa-91b3-1f9ef802a298', '66090a91-84d3-4cf2-81fe-cba1406055b9'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:47 devstack sudo[111914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:47 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:47 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.577s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:47 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Deleted volume successfully. Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7c244b91-35d1-4a08-b482-935c65dcbcd1 tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-e6608810-2331-4308-a090-ee86f49cb9eb-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-55930aa5-7ddb-43ae-9122-4048fe5b43ce-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-55930aa5-7ddb-43ae-9122-4048fe5b43ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "cinder-quobyte-55930aa5-7ddb-43ae-9122-4048fe5b43ce" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-55930aa5-7ddb-43ae-9122-4048fe5b43ce" acquired by "delete_volume" :: waited 0.015s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7b446f-9803-4a3e-bde7-1c80d3f4bc5a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:06:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:48 devstack sudo[111917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce Jun 12 05:06:48 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:48 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce" returned: 0 in 0.666s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:48 devstack sudo[111922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce Jun 12 05:06:48 devstack sudo[111922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:49 devstack sudo[111922]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-55930aa5-7ddb-43ae-9122-4048fe5b43ce" returned: 0 in 0.564s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-quobyte-55930aa5-7ddb-43ae-9122-4048fe5b43ce" released by "delete_volume" :: held 1.266s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Created reservations ['442ef805-b7df-4b8b-b4b5-ebaae2273c44', 'd7e9c374-b9c9-46b7-a3fa-6d6fd0d09d5d', 'c1eb26d0-a920-4399-9f61-92dfd2d224a7', '98e001aa-55d4-46f9-89fb-0dbf57a1e9a5'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:06:49 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:06:49 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:06:49 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.563s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:06:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Deleted volume successfully. Jun 12 05:06:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2ca3cc10-7cea-4b2f-b0ef-ae9e3d25d0fc tempest-CreateVolumesFromImageTest-1706168744 None] Lock "cinder-55930aa5-7ddb-43ae-9122-4048fe5b43ce-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:06:59 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=63,cinder:SELECT=50,cinder:INSERT=23,cinder:DELETE=7 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:06:59 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=46,cinder:INSERT=17,cinder:UPDATE=72,cinder:DELETE=5 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Flow 'volume_create_manager' (269b1f2d-00d1-4fac-adfc-de5f1c4b8e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b136fce-9104-44f3-819c-fdb65428fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b136fce-9104-44f3-819c-fdb65428fb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124049868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11859806-bc1b-48d0-8c1a-2fe90e3de6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2179d75152104874a02ef703da6ed5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:02Z,use_quota=True,user_id='c4a2aaae82a0409a9418e5bb998dac50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7949431-09c2-4179-b6fa-346948b615e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7949431-09c2-4179-b6fa-346948b615e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4128a1-1336-4b94-94d4-303efa9d7a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4128a1-1336-4b94-94d4-303efa9d7a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11859806-bc1b-48d0-8c1a-2fe90e3de6a0', 'volume_name': 'volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7a0ae8-ed2e-4735-ae07-a22936ac13c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7a0ae8-ed2e-4735-ae07-a22936ac13c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208593b5-470b-4c6d-8878-fd7ca78deaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:01 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Volume 11859806-bc1b-48d0-8c1a-2fe90e3de6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0', 'volume_size': 1} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124049868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11859806-bc1b-48d0-8c1a-2fe90e3de6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2179d75152104874a02ef703da6ed5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:02Z,use_quota=True,user_id='c4a2aaae82a0409a9418e5bb998dac50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Creating volume 11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:01 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:01 devstack sudo[111967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 1073741824 Jun 12 05:07:01 devstack sudo[111967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (127dd96b-e2ad-4638-bb9d-dff2eff6e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:01 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8d2e8f-ad72-48c8-ac7f-ffabfb3b1c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8d2e8f-ad72-48c8-ac7f-ffabfb3b1c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770692069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359dba5f-0438-435b-955c-c37ed48dea3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:02Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ffe171-14d0-4e63-97fe-cf5faef8084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ffe171-14d0-4e63-97fe-cf5faef8084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb64c43-38b3-4344-bc9f-86d1fbfea922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb64c43-38b3-4344-bc9f-86d1fbfea922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359dba5f-0438-435b-955c-c37ed48dea3c', 'volume_name': 'volume-359dba5f-0438-435b-955c-c37ed48dea3c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dd2c42-7611-4f8d-a382-a8035a93e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dd2c42-7611-4f8d-a382-a8035a93e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458bcb04-4ba7-43e8-9e09-47de3d3876d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Volume 359dba5f-0438-435b-955c-c37ed48dea3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359dba5f-0438-435b-955c-c37ed48dea3c', 'volume_size': 1} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (695b3cce-19af-4d5f-8500-9d1485385fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc117396-ba6b-40f5-bb98-5aa15784b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc117396-ba6b-40f5-bb98-5aa15784b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55948808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be81f3d-2279-4db9-a58c-898ebae8a610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:02Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bf1df5-90d8-44c8-9ed2-678c9f0f4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bf1df5-90d8-44c8-9ed2-678c9f0f4680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8728fed1-4370-442e-87a0-d9d3b51988e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8728fed1-4370-442e-87a0-d9d3b51988e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be81f3d-2279-4db9-a58c-898ebae8a610', 'volume_name': 'volume-3be81f3d-2279-4db9-a58c-898ebae8a610', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925bc597-a9ae-46c7-b547-5ddd35dd5e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925bc597-a9ae-46c7-b547-5ddd35dd5e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99624d24-823a-44df-b300-d5fd65169841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Volume 3be81f3d-2279-4db9-a58c-898ebae8a610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be81f3d-2279-4db9-a58c-898ebae8a610', 'volume_size': 1} Jun 12 05:07:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (9ee0b4c0-054c-4fb8-98e5-28e2f6f42cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdd2e98-02f4-42ae-8247-270a5be84345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdd2e98-02f4-42ae-8247-270a5be84345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492824128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:03Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a19ce4-a93d-454a-8708-a21aa6c3feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a19ce4-a93d-454a-8708-a21aa6c3feef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da739e-7da0-4ce6-8037-22e5d27a31d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da739e-7da0-4ce6-8037-22e5d27a31d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9', 'volume_name': 'volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c61945-f331-40ef-ac1a-e9ded4ef7ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack sudo[111967]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c61945-f331-40ef-ac1a-e9ded4ef7ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0925547-bf4b-482d-b492-741cd933070d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Volume 5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9', 'volume_size': 1} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 1073741824" returned: 0 in 1.292s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:03 devstack sudo[111973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:03 devstack sudo[111973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (7ce1439e-42ae-45b2-b403-6cb19bbede45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd9b09a-45d8-422c-908b-5fba5f24d7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd9b09a-45d8-422c-908b-5fba5f24d7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129507651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed6006c-bc85-49dd-8fca-0e827aad90d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:03Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad322f29-f5ab-400b-93f8-afafed753579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad322f29-f5ab-400b-93f8-afafed753579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44374bdc-61ae-4ecc-b67a-cdc2f191eaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44374bdc-61ae-4ecc-b67a-cdc2f191eaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed6006c-bc85-49dd-8fca-0e827aad90d3', 'volume_name': 'volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1453d71-af67-44fc-8728-efe77c836400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1453d71-af67-44fc-8728-efe77c836400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6a6fac-0d88-4a1a-b404-d5aafef9f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Volume 9ed6006c-bc85-49dd-8fca-0e827aad90d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3', 'volume_size': 1} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (247a1d22-df4d-40fb-9520-0513ffec4fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61aa3bcb-aff5-480e-950b-42c73447a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61aa3bcb-aff5-480e-950b-42c73447a517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908569253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f8a1e4-37f8-4c07-8319-38e67fed6e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:04Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b430a6b1-73fd-4c20-a1f9-62717e008cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b430a6b1-73fd-4c20-a1f9-62717e008cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8f6634-d372-442b-b9cf-bbebdabff419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8f6634-d372-442b-b9cf-bbebdabff419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f8a1e4-37f8-4c07-8319-38e67fed6e90', 'volume_name': 'volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be8ff42-bb7d-425e-9bd1-e67696ffe197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:04 devstack sudo[111973]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be8ff42-bb7d-425e-9bd1-e67696ffe197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d8235f-48d2-4b42-9c97-d553238a0712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Volume 23f8a1e4-37f8-4c07-8319-38e67fed6e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90', 'volume_size': 1} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 0.851s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770692069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359dba5f-0438-435b-955c-c37ed48dea3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:02Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Creating volume 359dba5f-0438-435b-955c-c37ed48dea3c {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:04 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208593b5-470b-4c6d-8878-fd7ca78deaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77f0cca-952f-42e6-8e5b-2b001cc02d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:04 devstack sudo[111976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c 1073741824 Jun 12 05:07:04 devstack sudo[111976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Volume volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 (11859806-bc1b-48d0-8c1a-2fe90e3de6a0): created successfully Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77f0cca-952f-42e6-8e5b-2b001cc02d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Flow 'volume_create_manager' (269b1f2d-00d1-4fac-adfc-de5f1c4b8e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:04 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-77f3a8b3-8ca7-4aa6-bd3c-eff55f3a7fc9 tempest-VolumeDependencyTests-1262585934 None] Created volume successfully. Jun 12 05:07:04 devstack sudo[111976]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c 1073741824" returned: 0 in 0.887s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:05 devstack sudo[111982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c Jun 12 05:07:05 devstack sudo[111982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:05 devstack sudo[111982]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.147s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55948808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be81f3d-2279-4db9-a58c-898ebae8a610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:02Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Creating volume 3be81f3d-2279-4db9-a58c-898ebae8a610 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:05 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458bcb04-4ba7-43e8-9e09-47de3d3876d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359dba5f-0438-435b-955c-c37ed48dea3c', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9cb927-c546-4cbc-94e9-896a23656c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:05 devstack sudo[111986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 1073741824 Jun 12 05:07:05 devstack sudo[111986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Volume volume-359dba5f-0438-435b-955c-c37ed48dea3c (359dba5f-0438-435b-955c-c37ed48dea3c): created successfully Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9cb927-c546-4cbc-94e9-896a23656c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (127dd96b-e2ad-4638-bb9d-dff2eff6e521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:05 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-fdc69506-508a-45f4-b026-eafa6046f21f tempest-CreateVolumesFromImageTest-1775526912 None] Created volume successfully. Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Flow 'volume_create_manager' (a358231a-336f-425e-92f5-f88d7618ee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6f268f-99c3-4474-8819-4e9979002604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6f268f-99c3-4474-8819-4e9979002604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa27e13-8425-436c-88d2-d8aef89d6167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa937346fce46dba9fb11aa5706ff3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:06Z,use_quota=True,user_id='30c8e664717e493486474346af47996b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c26de991-a520-48e5-b0d9-56052d69a07f),volume_type_id=c26de991-a520-48e5-b0d9-56052d69a07f)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6a75ee-c677-43d6-b0c5-e587a8345fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6a75ee-c677-43d6-b0c5-e587a8345fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e4aa68-e9c8-4af8-a83c-d849601d6857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e4aa68-e9c8-4af8-a83c-d849601d6857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1aa27e13-8425-436c-88d2-d8aef89d6167', 'volume_name': 'volume-1aa27e13-8425-436c-88d2-d8aef89d6167', 'volume_size': 1, 'image_id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/237aad78-6efc-4c49-a6da-9ae82f50a7af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5dd22b6e5c65f80b4a2a95504d65f3d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa937346fce46dba9fb11aa5706ff3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9a2b5ca12e87f9bdd3cde344b6d434eac645f5787cd3370403b311e0b6d2b102ee378a40127f59a1c787515c4e4f1b08feef4fc69ac457da45b676a5292c9ea', 'id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'created_at': datetime.datetime(2026, 6, 12, 3, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/237aad78-6efc-4c49-a6da-9ae82f50a7af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e12e8c-223e-484f-99ba-cffb15326bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e12e8c-223e-484f-99ba-cffb15326bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fe1c55-bc95-499e-97a8-7c65556bd7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:06 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Volume 1aa27e13-8425-436c-88d2-d8aef89d6167: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1aa27e13-8425-436c-88d2-d8aef89d6167', 'volume_size': 1, 'image_id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/237aad78-6efc-4c49-a6da-9ae82f50a7af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5dd22b6e5c65f80b4a2a95504d65f3d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa937346fce46dba9fb11aa5706ff3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9a2b5ca12e87f9bdd3cde344b6d434eac645f5787cd3370403b311e0b6d2b102ee378a40127f59a1c787515c4e4f1b08feef4fc69ac457da45b676a5292c9ea', 'id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'created_at': datetime.datetime(2026, 6, 12, 3, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/237aad78-6efc-4c49-a6da-9ae82f50a7af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Trying to clone 1aa27e13-8425-436c-88d2-d8aef89d6167 from image 237aad78-6efc-4c49-a6da-9ae82f50a7af at location (None, [{'url': 'file:///opt/stack/data/glance/images/237aad78-6efc-4c49-a6da-9ae82f50a7af', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 05:07:06 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Image download 0.00 MB at 0.00 MB/s Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9803257-670c-4c74-90b0-41beed442c9a]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:06 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD Jun 12 05:07:06 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:06 devstack sudo[111986]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 1073741824" returned: 0 in 1.030s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:06 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 Jun 12 05:07:06 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:07 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD" returned: 0 in 0.805s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:07 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610" returned: 0 in 0.714s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.431s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492824128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:03Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Creating volume 5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:07 devstack sudo[111999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:07 devstack sudo[111999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:07 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:07 devstack sudo[112001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 1073741824 Jun 12 05:07:07 devstack sudo[112001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99624d24-823a-44df-b300-d5fd65169841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be81f3d-2279-4db9-a58c-898ebae8a610', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b9472d-6286-4574-9368-7a180e7c1187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:07 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Volume volume-3be81f3d-2279-4db9-a58c-898ebae8a610 (3be81f3d-2279-4db9-a58c-898ebae8a610): created successfully Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b9472d-6286-4574-9368-7a180e7c1187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (695b3cce-19af-4d5f-8500-9d1485385fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a17f3668-50ba-49ae-8639-c8eb81a942b1 tempest-CreateVolumesFromImageTest-1775526912 None] Created volume successfully. Jun 12 05:07:08 devstack sudo[111999]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD" returned: 1 in 0.729s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Temporary image 237aad78-6efc-4c49-a6da-9ae82f50a7af is fetched for user 30c8e664717e493486474346af47996b. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[610851da-68c4-4970-8752-2cb85c8d6f15]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:08 devstack sudo[112009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD Jun 12 05:07:08 devstack sudo[112009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:08 devstack sudo[112001]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 1073741824" returned: 0 in 0.995s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:08 devstack sudo[112012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 Jun 12 05:07:08 devstack sudo[112012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:09 devstack sudo[112009]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD" returned: 0 in 0.955s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:09 devstack sudo[112012]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9" returned: 0 in 0.648s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.675s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129507651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed6006c-bc85-49dd-8fca-0e827aad90d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:03Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Creating volume 9ed6006c-bc85-49dd-8fca-0e827aad90d3 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:09 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0925547-bf4b-482d-b492-741cd933070d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd73907-7b14-44f9-b387-e2cef75ad300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:09 devstack sudo[112018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 1073741824 Jun 12 05:07:09 devstack sudo[112018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Volume volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 (5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9): created successfully Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd73907-7b14-44f9-b387-e2cef75ad300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:09 devstack sudo[112017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (9ee0b4c0-054c-4fb8-98e5-28e2f6f42cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:09 devstack sudo[112017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f7adf30d-fe9d-4e29-85df-409dcf083295 tempest-CreateVolumesFromImageTest-1775526912 None] Created volume successfully. Jun 12 05:07:09 devstack sudo[112017]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD" returned: 1 in 0.724s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:07:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:10 devstack sudo[112018]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 1073741824" returned: 0 in 0.939s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:10 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 Jun 12 05:07:10 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:10 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3" returned: 0 in 0.572s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.812s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908569253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f8a1e4-37f8-4c07-8319-38e67fed6e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b651eac4ca746ee9191470cc5474604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:04Z,use_quota=True,user_id='baf3947e249c4989b795c7b08becbcc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Creating volume 23f8a1e4-37f8-4c07-8319-38e67fed6e90 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:10 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6a6fac-0d88-4a1a-b404-d5aafef9f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:10 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 1073741824 Jun 12 05:07:10 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158b728-d687-4491-9ec4-15da7c073a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:10 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Volume volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 (9ed6006c-bc85-49dd-8fca-0e827aad90d3): created successfully Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158b728-d687-4491-9ec4-15da7c073a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (7ce1439e-42ae-45b2-b403-6cb19bbede45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:10 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-86e7305e-107a-45d2-8f0f-d32150cfc1c7 tempest-CreateVolumesFromImageTest-1775526912 None] Created volume successfully. Jun 12 05:07:11 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 1073741824" returned: 0 in 0.858s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:11 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 Jun 12 05:07:11 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:12 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90" returned: 0 in 0.595s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.927s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d8235f-48d2-4b42-9c97-d553238a0712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06d5785-e59a-4c98-83a2-41ec3d72a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Creating offline snapshot 941885bc-a870-4653-9f3e-a164d6073602 of volume 11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:07:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Volume volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 (23f8a1e4-37f8-4c07-8319-38e67fed6e90): created successfully Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06d5785-e59a-4c98-83a2-41ec3d72a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Flow 'volume_create_manager' (247a1d22-df4d-40fb-9520-0513ffec4fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b174e62-94a6-45f2-9521-6ec7dc97fb32]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-32f3ef3d-2071-4531-b287-7d3ba77e583f tempest-CreateVolumesFromImageTest-1775526912 None] Created volume successfully. Jun 12 05:07:12 devstack sudo[112039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:12 devstack sudo[112039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-23f8a1e4-37f8-4c07-8319-38e67fed6e90-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-23f8a1e4-37f8-4c07-8319-38e67fed6e90-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-quobyte-23f8a1e4-37f8-4c07-8319-38e67fed6e90" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-23f8a1e4-37f8-4c07-8319-38e67fed6e90" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aac9c0-3551-4373-974c-44d14490054c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:13 devstack sudo[112039]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 0.792s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:13 devstack sudo[112045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 Jun 12 05:07:13 devstack sudo[112045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:13 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 1G Jun 12 05:07:13 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:13 devstack sudo[112045]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90" returned: 0 in 0.831s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:13 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90 Jun 12 05:07:13 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:14 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 1G" returned: 0 in 0.862s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:14 devstack sudo[112057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 Jun 12 05:07:14 devstack sudo[112057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:14 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-23f8a1e4-37f8-4c07-8319-38e67fed6e90" returned: 0 in 0.634s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-23f8a1e4-37f8-4c07-8319-38e67fed6e90" released by "delete_volume" :: held 1.517s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Created reservations ['2bd7e55d-d905-42ad-bde1-13b8f6d79845', '6a120c2a-3590-4aec-bf98-81e21a52c3df', 'd030a57b-1e44-4326-a86c-67c3f8708588', 'b644e4c3-e734-4308-804a-22e233088ff6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:14 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:14 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:14 devstack sudo[112057]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602" returned: 0 in 0.790s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:14 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 is being set with open permissions: ugo+rw Jun 12 05:07:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:14 devstack sudo[112065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 Jun 12 05:07:14 devstack sudo[112065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-9ed6006c-bc85-49dd-8fca-0e827aad90d3-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-9ed6006c-bc85-49dd-8fca-0e827aad90d3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-quobyte-9ed6006c-bc85-49dd-8fca-0e827aad90d3" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-9ed6006c-bc85-49dd-8fca-0e827aad90d3" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7fab9-9944-423a-990d-ab23fc9670c4]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:15 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.700s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Deleted volume successfully. Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-8a1ffe3f-ed00-41c4-8df5-ab28240f13f9 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-23f8a1e4-37f8-4c07-8319-38e67fed6e90-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:15 devstack sudo[112065]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602" returned: 0 in 0.668s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:15 devstack sudo[112069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 Jun 12 05:07:15 devstack sudo[112069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:15 devstack sudo[112070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info Jun 12 05:07:15 devstack sudo[112070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:16 devstack sudo[112070]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info" returned: 0 in 0.679s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:16 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info is being set with open permissions: ugo+rw Jun 12 05:07:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:16 devstack sudo[112069]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3" returned: 0 in 0.812s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:16 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info Jun 12 05:07:16 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:16 devstack sudo[112078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3 Jun 12 05:07:16 devstack sudo[112078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:16 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.info" returned: 0 in 0.711s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:16 devstack sudo[112078]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.025s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa27e13-8425-436c-88d2-d8aef89d6167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa937346fce46dba9fb11aa5706ff3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:06Z,use_quota=True,user_id='30c8e664717e493486474346af47996b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c26de991-a520-48e5-b0d9-56052d69a07f),volume_type_id=c26de991-a520-48e5-b0d9-56052d69a07f)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Creating volume 1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:17 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-9ed6006c-bc85-49dd-8fca-0e827aad90d3" returned: 0 in 0.788s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:17 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 1073741824 Jun 12 05:07:17 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-9ed6006c-bc85-49dd-8fca-0e827aad90d3" released by "delete_volume" :: held 1.647s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-dac3aa12-c5d1-4868-a550-c06a54143253 tempest-VolumeDependencyTests-1262585934 None] Create snapshot completed successfully Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Created reservations ['bffd4a78-9c0f-43b5-9f50-a68f462eb68b', 'b6f3a8e3-59da-4aef-95e6-d660a1ee5117', 'd68d6b5e-414e-43fb-b220-e312fe1f36be', 'b0df46cd-76c6-44fa-a3a2-7f9cb7c48673'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:17 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:17 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-quobyte-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dd8209-6691-4044-b34a-906931536d6b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:17 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.703s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:17 devstack sudo[112090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 Jun 12 05:07:17 devstack sudo[112090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Deleted volume successfully. Jun 12 05:07:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9b1617fa-68cd-46cf-808f-ca1cc5324cc3 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-9ed6006c-bc85-49dd-8fca-0e827aad90d3-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:18 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 1073741824" returned: 0 in 1.066s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:18 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:18 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Flow 'volume_create_manager' (368f2544-ac3a-4cfd-9593-4bb7c42603e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe84216-b64f-4897-b2a8-938c7c9a7be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe84216-b64f-4897-b2a8-938c7c9a7be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1602410139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7ca8a5-1134-41e0-a933-90c9dd5536e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2179d75152104874a02ef703da6ed5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=941885bc-a870-4653-9f3e-a164d6073602,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:19Z,use_quota=True,user_id='c4a2aaae82a0409a9418e5bb998dac50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578a3856-18c2-4733-8bcb-6255264dcc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578a3856-18c2-4733-8bcb-6255264dcc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab456638-a327-4d29-b616-5bab069a536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:18 devstack sudo[112090]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab456638-a327-4d29-b616-5bab069a536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa7ca8a5-1134-41e0-a933-90c9dd5536e8', 'volume_name': 'volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8', 'volume_size': 1, 'snapshot_id': '941885bc-a870-4653-9f3e-a164d6073602'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e089148e-8d0b-4918-95a1-9f92467eaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e089148e-8d0b-4918-95a1-9f92467eaaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8361e7f-e5e5-4ede-857c-447a83270021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:18 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Volume fa7ca8a5-1134-41e0-a933-90c9dd5536e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8', 'volume_size': 1, 'snapshot_id': '941885bc-a870-4653-9f3e-a164d6073602'} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9" returned: 0 in 0.967s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:18 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9 Jun 12 05:07:18 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:18 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 0 in 0.733s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.119s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-quobyte-941885bc-a870-4653-9f3e-a164d6073602-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-941885bc-a870-4653-9f3e-a164d6073602-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Creating volume fa7ca8a5-1134-41e0-a933-90c9dd5536e8 from snapshot 941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-quobyte-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] snapshot: 941885bc-a870-4653-9f3e-a164d6073602, volume: fa7ca8a5-1134-41e0-a933-90c9dd5536e8, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Attempting download of 237aad78-6efc-4c49-a6da-9ae82f50a7af ((None, [{'url': 'file:///opt/stack/data/glance/images/237aad78-6efc-4c49-a6da-9ae82f50a7af', 'metadata': {}}])) to volume 1aa27e13-8425-436c-88d2-d8aef89d6167. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c54a4b-1ebe-41fb-8a7c-4bde417cd06c]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449a9f0-5f29-4e6b-865f-ce3b8f7f9246]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:19 devstack sudo[112103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 Jun 12 05:07:19 devstack sudo[112103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:19 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290 Jun 12 05:07:19 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:19 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9" returned: 0 in 0.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9" released by "delete_volume" :: held 1.726s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Created reservations ['0b8782b3-e123-4bf1-aa9d-c34b636aaae9', '494de15f-67af-4f50-966f-c8a4b324cf94', '9b3a3244-6edb-42e1-956c-3036a96e01d8', 'f6abb112-20a6-4019-a61b-2fa6fda4cbb9'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:19 devstack sudo[112113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:19 devstack sudo[112113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:19 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290" returned: 0 in 0.910s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-3be81f3d-2279-4db9-a58c-898ebae8a610-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-3be81f3d-2279-4db9-a58c-898ebae8a610-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-quobyte-3be81f3d-2279-4db9-a58c-898ebae8a610" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:20 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290 Jun 12 05:07:20 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:20 devstack sudo[112103]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-3be81f3d-2279-4db9-a58c-898ebae8a610" acquired by "delete_volume" :: waited 0.028s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602" returned: 0 in 1.116s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db804c-56a4-48b6-a945-71e308404f46]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a67f429-d038-4c1a-8ffa-8446f346ec4b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:20 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:20 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:20 devstack sudo[112122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 Jun 12 05:07:20 devstack sudo[112122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:20 devstack sudo[112113]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.825s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:20 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Deleted volume successfully. Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7780259d-ad6e-4775-8ebc-66c1e098cd01 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-5d7b490a-5c63-40d0-a2bf-68ea1a62ffc9-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:20 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290" returned: 1 in 0.953s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_237aad78-6efc-4c49-a6da-9ae82f50a7af_05nwi290' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7952e-1282-4b4b-bee7-48b2b7e292a3]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:21 devstack sudo[112129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD Jun 12 05:07:21 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:21 devstack sudo[112122]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610" returned: 0 in 0.963s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:21 devstack sudo[112137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610 Jun 12 05:07:21 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:21 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 1.028s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:21 devstack sudo[112139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 Jun 12 05:07:21 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:21 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3be81f3d-2279-4db9-a58c-898ebae8a610" returned: 0 in 0.651s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-3be81f3d-2279-4db9-a58c-898ebae8a610" released by "delete_volume" :: held 1.675s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Created reservations ['1e7f0f94-4a39-4282-8d1a-b631e1eb29b4', 'edc8a595-dd14-4a62-94f3-f916fe133d5e', '8c30557c-6ef2-4b1b-a61a-a0a2a376437c', 'f174f68c-4400-4b63-bedf-9c17723e0808'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:21 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD" returned: 0 in 0.988s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:21 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:21 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:21 devstack sudo[112146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD Jun 12 05:07:21 devstack sudo[112146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-359dba5f-0438-435b-955c-c37ed48dea3c-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-359dba5f-0438-435b-955c-c37ed48dea3c-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "cinder-quobyte-359dba5f-0438-435b-955c-c37ed48dea3c" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-359dba5f-0438-435b-955c-c37ed48dea3c" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141966b-cde1-48ee-805a-3c0e4a1ab9c4]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:23 devstack sudo[112159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c Jun 12 05:07:23 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:23 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.353s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Deleted volume successfully. Jun 12 05:07:23 devstack sudo[112146]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3d19c617-2bf3-4277-bfcc-2d5b9e542296 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-3be81f3d-2279-4db9-a58c-898ebae8a610-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD" returned: 1 in 1.552s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] 237aad78-6efc-4c49-a6da-9ae82f50a7af was raw, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 05:07:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:23 devstack sudo[112165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:23 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:24 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c" returned: 0 in 2.130s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:25 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:25 devstack sudo[112174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c Jun 12 05:07:25 devstack sudo[112174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 0 in 1.642s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:25 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_237aad78-6efc-4c49-a6da-9ae82f50a7af_1t0enb45devstack@QuobyteHD, size 0.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:07:25 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Converted 0.00 MB image at 0.00 MB/s Jun 12 05:07:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:25 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 1G Jun 12 05:07:25 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:26 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 1G" returned: 0 in 1.461s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:26 devstack sudo[112174]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-359dba5f-0438-435b-955c-c37ed48dea3c" returned: 0 in 1.622s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-quobyte-359dba5f-0438-435b-955c-c37ed48dea3c" released by "delete_volume" :: held 3.855s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:26 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7df4584-0af0-4a7b-bc2d-013c4275ccc8]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:26 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Created reservations ['e0d27edc-4f48-485c-a51e-d9ad8aa3081a', 'e3f0d9f9-6c82-4ef4-ba3a-bb4f5f6dbfe3', '02ca17b8-f11e-4554-b6c7-a80077c08ca9', 'bd6259d0-f6e1-4aa6-952f-16095306728f'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:26 devstack sudo[112183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:26 devstack sudo[112183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:27 devstack sudo[112185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:27 devstack sudo[112185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:27 devstack sudo[112183]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 0 in 1.263s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:28 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" returned: 0 in 6.847s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:28 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[119112ad-3385-4117-b08d-975a91469d02]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:28 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:28 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:28 devstack sudo[112190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:28 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:28 devstack sudo[112185]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 1.431s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:28 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Deleted volume successfully. Jun 12 05:07:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-32739541-7513-40c4-8e81-78fd29ec91d7 tempest-CreateVolumesFromImageTest-1775526912 None] Lock "cinder-359dba5f-0438-435b-955c-c37ed48dea3c-delete_volume" released by "delete_volume" :: held 6.033s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:29 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 1 in 1.114s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Downloaded image 237aad78-6efc-4c49-a6da-9ae82f50a7af ((None, [{'url': 'file:///opt/stack/data/glance/images/237aad78-6efc-4c49-a6da-9ae82f50a7af', 'metadata': {}}])) to volume 1aa27e13-8425-436c-88d2-d8aef89d6167 successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Temporary image 237aad78-6efc-4c49-a6da-9ae82f50a7af for user 30c8e664717e493486474346af47996b is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Marking volume 1aa27e13-8425-436c-88d2-d8aef89d6167 as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Copying metadata from image 237aad78-6efc-4c49-a6da-9ae82f50a7af to 1aa27e13-8425-436c-88d2-d8aef89d6167. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Creating volume glance metadata for volume 1aa27e13-8425-436c-88d2-d8aef89d6167 backed by image 237aad78-6efc-4c49-a6da-9ae82f50a7af with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5dd22b6e5c65f80b4a2a95504d65f3d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fe1c55-bc95-499e-97a8-7c65556bd7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa27e13-8425-436c-88d2-d8aef89d6167', 'volume_size': 1, 'image_id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/237aad78-6efc-4c49-a6da-9ae82f50a7af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5dd22b6e5c65f80b4a2a95504d65f3d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfa937346fce46dba9fb11aa5706ff3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9a2b5ca12e87f9bdd3cde344b6d434eac645f5787cd3370403b311e0b6d2b102ee378a40127f59a1c787515c4e4f1b08feef4fc69ac457da45b676a5292c9ea', 'id': '237aad78-6efc-4c49-a6da-9ae82f50a7af', 'created_at': datetime.datetime(2026, 6, 12, 3, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/237aad78-6efc-4c49-a6da-9ae82f50a7af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d62ff9-f29d-4262-91b6-d7aca6cf0408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:29 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Volume volume-1aa27e13-8425-436c-88d2-d8aef89d6167 (1aa27e13-8425-436c-88d2-d8aef89d6167): created successfully Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d62ff9-f29d-4262-91b6-d7aca6cf0408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Flow 'volume_create_manager' (a358231a-336f-425e-92f5-f88d7618ee3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:29 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f023ae7f-bee3-48dd-be9e-15e8deaf0920 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Created volume successfully. Jun 12 05:07:29 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 1.259s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:07:29 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Converted 1024.00 MB image at 149.53 MB/s Jun 12 05:07:29 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 is being set with open permissions: ugo+rw Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:29 devstack sudo[112202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 Jun 12 05:07:29 devstack sudo[112202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Acquiring lock "cinder-1aa27e13-8425-436c-88d2-d8aef89d6167-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "cinder-1aa27e13-8425-436c-88d2-d8aef89d6167-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Acquiring lock "cinder-quobyte-1aa27e13-8425-436c-88d2-d8aef89d6167" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "cinder-quobyte-1aa27e13-8425-436c-88d2-d8aef89d6167" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Flow 'volume_create_manager' (517f0677-7762-46cc-a8df-78f08d6f42a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4cb867-7677-4a0f-b78f-79f5f828e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bacb454-518d-4eb6-b388-2ec8b75f01c6]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4cb867-7677-4a0f-b78f-79f5f828e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-255112984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20887f11-4f98-4690-aa86-3ff8b9d5830b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c9df5b654b4c6293d8e51dae894fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:30Z,use_quota=True,user_id='cd18147e3abf440bbe8f0d6dcc4fa5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1206717-1e9d-46f8-bb64-dbe0f4293448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1206717-1e9d-46f8-bb64-dbe0f4293448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360c781a-2bc4-4951-9dc7-b2fbc166fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360c781a-2bc4-4951-9dc7-b2fbc166fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20887f11-4f98-4690-aa86-3ff8b9d5830b', 'volume_name': 'volume-20887f11-4f98-4690-aa86-3ff8b9d5830b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf43a0f-493b-408b-a9a4-846d68cd3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf43a0f-493b-408b-a9a4-846d68cd3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1402d05f-55ec-42af-b553-6b6310c4ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:29 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Volume 20887f11-4f98-4690-aa86-3ff8b9d5830b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20887f11-4f98-4690-aa86-3ff8b9d5830b', 'volume_size': 1} Jun 12 05:07:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:30 devstack sudo[112204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:30 devstack sudo[112204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:30 devstack sudo[112202]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" returned: 0 in 0.724s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" released by "_copy_volume_from_snapshot" :: held 11.144s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-941885bc-a870-4653-9f3e-a164d6073602-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" released by "_create_volume_from_snapshot" :: held 11.180s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.200s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-255112984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20887f11-4f98-4690-aa86-3ff8b9d5830b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c9df5b654b4c6293d8e51dae894fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:30Z,use_quota=True,user_id='cd18147e3abf440bbe8f0d6dcc4fa5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Creating volume 20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:30 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:30 devstack sudo[112207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b 1073741824 Jun 12 05:07:30 devstack sudo[112207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8361e7f-e5e5-4ede-857c-447a83270021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8', 'volume_size': 1, 'snapshot_id': '941885bc-a870-4653-9f3e-a164d6073602'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b15b85b-d274-4ea3-ae01-81f71ba123d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:30 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Volume volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 (fa7ca8a5-1134-41e0-a933-90c9dd5536e8): created successfully Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b15b85b-d274-4ea3-ae01-81f71ba123d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Flow 'volume_create_manager' (368f2544-ac3a-4cfd-9593-4bb7c42603e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c27138e7-3bef-4f3f-8b15-837c0c5813ed tempest-VolumeDependencyTests-1262585934 None] Created volume successfully. Jun 12 05:07:30 devstack sudo[112204]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 0 in 0.729s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:30 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:30 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:30 devstack sudo[112207]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b 1073741824" returned: 0 in 0.848s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-941885bc-a870-4653-9f3e-a164d6073602-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-941885bc-a870-4653-9f3e-a164d6073602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-quobyte-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:31 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:07:31 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-quobyte-941885bc-a870-4653-9f3e-a164d6073602" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-941885bc-a870-4653-9f3e-a164d6073602" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Deleting offline snapshot 941885bc-a870-4653-9f3e-a164d6073602 of volume 11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] snapshot_file for this snap is: volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27b6bea-eaf9-4247-9f58-566fe131eb0c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:31 devstack sudo[112220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 Jun 12 05:07:31 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:31 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (a55705c8-aa85-464c-a9e1-e06d85d29659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1e9073-6c9a-48e2-9dc9-f36979adac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 1 in 0.793s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1e9073-6c9a-48e2-9dc9-f36979adac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622227450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99069a49-1ba1-474f-8302-f738d42a68f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:31Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c4313-8f84-45a3-ab98-870a48548467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c4313-8f84-45a3-ab98-870a48548467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65145b60-618b-459f-a2fd-1f97fb51265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:31 devstack sudo[112225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167 Jun 12 05:07:31 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65145b60-618b-459f-a2fd-1f97fb51265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99069a49-1ba1-474f-8302-f738d42a68f9', 'volume_name': 'volume-99069a49-1ba1-474f-8302-f738d42a68f9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4250d1-5bd1-42c0-ab15-d92d51bdb677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4250d1-5bd1-42c0-ab15-d92d51bdb677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5327d552-1f37-465f-8345-87da23cecff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:31 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume 99069a49-1ba1-474f-8302-f738d42a68f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99069a49-1ba1-474f-8302-f738d42a68f9', 'volume_size': 1} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:31 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.817s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:31 devstack sudo[112230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:31 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-622227450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99069a49-1ba1-474f-8302-f738d42a68f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:31Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Creating volume 99069a49-1ba1-474f-8302-f738d42a68f9 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:31 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1402d05f-55ec-42af-b553-6b6310c4ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20887f11-4f98-4690-aa86-3ff8b9d5830b', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949b4583-613f-4885-ba5c-0d468bf7f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:31 devstack sudo[112234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 1073741824 Jun 12 05:07:31 devstack sudo[112234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:31 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Volume volume-20887f11-4f98-4690-aa86-3ff8b9d5830b (20887f11-4f98-4690-aa86-3ff8b9d5830b): created successfully Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949b4583-613f-4885-ba5c-0d468bf7f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:31 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Flow 'volume_create_manager' (517f0677-7762-46cc-a8df-78f08d6f42a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:31 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-faafbef5-a191-4018-8b65-e7101cb552a0 tempest-SnapshotDependencyTests-869218687 None] Created volume successfully. Jun 12 05:07:32 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602" returned: 0 in 0.881s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a82757a-302f-4410-89b6-fce78160bf72]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:32 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1aa27e13-8425-436c-88d2-d8aef89d6167" returned: 0 in 0.716s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:32 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:32 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "cinder-quobyte-1aa27e13-8425-436c-88d2-d8aef89d6167" released by "delete_volume" :: held 2.378s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Created reservations ['8a34f1e0-9a1d-413e-83d9-4ba6c77be663', 'f5d361be-b665-427f-b49b-747de7601b63', 'abc30081-101d-4e9b-a93f-fb42689d9111', 'b703dacb-364f-4196-97a9-7e7173565ef3'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:32 devstack sudo[112239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:32 devstack sudo[112239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:32 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.818s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:07:32 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 0.861s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:32 devstack sudo[112250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 Jun 12 05:07:32 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:32 devstack sudo[112234]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 1073741824" returned: 0 in 1.099s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:32 devstack sudo[112239]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.644s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:32 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Deleted volume successfully. Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-56a062ed-5026-44f8-9d9d-d48777d9cc35 tempest-VolumeAndVolumeTypeFromImageTest-375667122 None] Lock "cinder-1aa27e13-8425-436c-88d2-d8aef89d6167-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:33 devstack sudo[112252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 Jun 12 05:07:33 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:33 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9" returned: 0 in 0.723s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.266s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Creating offline snapshot 4c7e60b7-5008-4df6-898d-c535eacd8c9f of volume 20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5327d552-1f37-465f-8345-87da23cecff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99069a49-1ba1-474f-8302-f738d42a68f9', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f7904-5677-49cd-8623-74963b52d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[102027d0-7716-4bb5-b10f-c83f28401c80]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:33 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume volume-99069a49-1ba1-474f-8302-f738d42a68f9 (99069a49-1ba1-474f-8302-f738d42a68f9): created successfully Jun 12 05:07:33 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f7904-5677-49cd-8623-74963b52d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (a55705c8-aa85-464c-a9e1-e06d85d29659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602" returned: 0 in 0.929s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:33 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:33 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2178fdcd-7bec-478b-9687-2df73546b74b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created volume successfully. Jun 12 05:07:33 devstack sudo[112261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602 Jun 12 05:07:33 devstack sudo[112261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:33 devstack sudo[112260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:07:33 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:34 devstack sudo[112261]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0.941885bc-a870-4653-9f3e-a164d6073602" returned: 0 in 0.731s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:34 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.840s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-941885bc-a870-4653-9f3e-a164d6073602" released by "_delete_snapshot" :: held 3.566s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" released by "delete_snapshot" :: held 3.594s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:34 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f 1G Jun 12 05:07:34 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Created reservations ['b42ccf4c-0e61-475d-8abd-84cd3dccbf84', 'f04b1b80-c462-4888-9262-0e798949ff22', 'efd2da4f-5f1d-4e10-8459-1733bb4da53a', 'ef0dc290-ef87-4cc5-af44-53a48d731b51'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:34 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Delete snapshot completed successfully. Jun 12 05:07:34 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-7f52e5fd-f67d-4824-9cb1-1934643b1f7d tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-941885bc-a870-4653-9f3e-a164d6073602-delete_snapshot" released by "delete_snapshot" :: held 3.757s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (1954db7b-a808-454a-86bd-7607aadaf756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2390d7ce-9763-4b7a-9f70-755a8bbd56a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2390d7ce-9763-4b7a-9f70-755a8bbd56a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-831050036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a835be2-f463-4c76-ba06-6ccfcf0a3e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:35Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f7b4c1-6568-42ce-994d-244948325181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f7b4c1-6568-42ce-994d-244948325181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485196ab-bac9-4136-bf2f-ef7cbdf1e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485196ab-bac9-4136-bf2f-ef7cbdf1e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a835be2-f463-4c76-ba06-6ccfcf0a3e1d', 'volume_name': 'volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe67148-65a3-431e-8437-77362d972eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe67148-65a3-431e-8437-77362d972eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc10faa-80f0-46b7-9d56-2df8aecc9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume 3a835be2-f463-4c76-ba06-6ccfcf0a3e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d', 'volume_size': 1} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-11859806-bc1b-48d0-8c1a-2fe90e3de6a0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-11859806-bc1b-48d0-8c1a-2fe90e3de6a0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-quobyte-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" acquired by "delete_volume" :: waited 0.034s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a158e-8d15-4eb4-b610-69c1c616e9f9]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (9495af89-8ce8-41b4-84c5-ca36d5c7137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79408b58-f874-4793-945a-1fa96e695fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79408b58-f874-4793-945a-1fa96e695fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771087289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf093753-4a55-488c-aede-e2e1b173b1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:36Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4b4111-70e2-4738-a06f-71fdd6a833e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4b4111-70e2-4738-a06f-71fdd6a833e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b715fe-3e34-4a27-9fc8-3ec1c6066189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b715fe-3e34-4a27-9fc8-3ec1c6066189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf093753-4a55-488c-aede-e2e1b173b1e0', 'volume_name': 'volume-bf093753-4a55-488c-aede-e2e1b173b1e0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaafd24-7979-4b85-8c31-ae36249983e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaafd24-7979-4b85-8c31-ae36249983e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:35 devstack sudo[112274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:35 devstack sudo[112274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a32bc-2674-48e7-8324-233f285bdcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:35 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume bf093753-4a55-488c-aede-e2e1b173b1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf093753-4a55-488c-aede-e2e1b173b1e0', 'volume_size': 1} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:35 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f 1G" returned: 0 in 1.155s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:35 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20887f11-4f98-4690-aa86-3ff8b9d5830b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:35 devstack sudo[112276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20887f11-4f98-4690-aa86-3ff8b9d5830b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f Jun 12 05:07:35 devstack sudo[112276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (105bf722-30e2-4a3b-8193-cd9dd0538767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa771ab-9b37-450a-8662-395d1c25ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa771ab-9b37-450a-8662-395d1c25ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1568355520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c6f2e0-fa89-4470-acd2-c99f8ca81716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:36Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f76b08-d45b-4f59-a4c3-027a55b47a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f76b08-d45b-4f59-a4c3-027a55b47a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2b0ebd-6ac7-45a9-8c21-9106d225e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2b0ebd-6ac7-45a9-8c21-9106d225e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c6f2e0-fa89-4470-acd2-c99f8ca81716', 'volume_name': 'volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeda933-01f3-4d9a-8231-ccd6485728a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeda933-01f3-4d9a-8231-ccd6485728a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76eb9fc-cc1c-404b-835e-2529fe5c98b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume 89c6f2e0-fa89-4470-acd2-c99f8ca81716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716', 'volume_size': 1} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:36 devstack sudo[112274]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 1.148s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:36 devstack sudo[112276]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:36 devstack sudo[112284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0 Jun 12 05:07:36 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (3a46cd1f-ea68-4c55-9962-1fd30d5787f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d02d1d2-fe99-4620-a44f-cbbabd1decd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20887f11-4f98-4690-aa86-3ff8b9d5830b -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f" returned: 0 in 1.033s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:36 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f is being set with open permissions: ugo+rw Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d02d1d2-fe99-4620-a44f-cbbabd1decd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893828495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece35b7b-03fa-4fb8-b30f-ff5f58604116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:37Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9a7609-dc48-406f-a157-e4c3cf18f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack sudo[112286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f Jun 12 05:07:36 devstack sudo[112286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9a7609-dc48-406f-a157-e4c3cf18f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197d02cd-425e-48a4-ad98-64fe9f0ba171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197d02cd-425e-48a4-ad98-64fe9f0ba171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece35b7b-03fa-4fb8-b30f-ff5f58604116', 'volume_name': 'volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49797512-5bdd-444b-b5e5-a37a5cf4d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49797512-5bdd-444b-b5e5-a37a5cf4d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c4db9e-aef0-41aa-b2bc-571a37858bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:36 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume ece35b7b-03fa-4fb8-b30f-ff5f58604116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116', 'volume_size': 1} Jun 12 05:07:36 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (e832ce9d-0f54-423b-bc99-2a5e0cad4959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a496b5b6-5464-40d0-9066-3bfe8df3b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a496b5b6-5464-40d0-9066-3bfe8df3b911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700690655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb724c27-ab6f-467f-9567-3990ab0c8254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:37Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdb229a-4f0a-4a79-8d82-07c66eb63164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdb229a-4f0a-4a79-8d82-07c66eb63164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3ca542-82cd-4050-b301-182d0a79b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3ca542-82cd-4050-b301-182d0a79b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb724c27-ab6f-467f-9567-3990ab0c8254', 'volume_name': 'volume-fb724c27-ab6f-467f-9567-3990ab0c8254', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c96aceb-e968-4b27-8787-b1d2f1f50217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c96aceb-e968-4b27-8787-b1d2f1f50217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62293c9-ca59-454c-96f3-6b1f57100d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:37 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume fb724c27-ab6f-467f-9567-3990ab0c8254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb724c27-ab6f-467f-9567-3990ab0c8254', 'volume_size': 1} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:37 devstack sudo[112286]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f" returned: 0 in 0.679s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:37 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" returned: 0 in 0.777s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-11859806-bc1b-48d0-8c1a-2fe90e3de6a0" released by "delete_volume" :: held 2.013s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:37 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info Jun 12 05:07:37 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Created reservations ['153707ea-498e-4afe-99e6-454c8943b683', '8f76b96c-372c-421a-94a3-ae6bcdab2460', 'b46c1807-54ee-49c0-bd51-2e96525f2230', '9f4e7ee9-2608-483c-bee1-80f43079184b'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:37 devstack sudo[112292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:37 devstack sudo[112292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-fa7ca8a5-1134-41e0-a933-90c9dd5536e8-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-fa7ca8a5-1134-41e0-a933-90c9dd5536e8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "cinder-quobyte-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[4326997e-6950-42d8-81b6-5e8f84f67950]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:37 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:38 devstack sudo[112294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 Jun 12 05:07:38 devstack sudo[112294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:38 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info" returned: 0 in 0.787s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:38 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info is being set with open permissions: ugo+rw Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:38 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info Jun 12 05:07:38 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:38 devstack sudo[112292]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.956s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:38 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Deleted volume successfully. Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-680a0d23-3d6e-4420-ba55-8d6fea688f55 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-11859806-bc1b-48d0-8c1a-2fe90e3de6a0-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:38 devstack sudo[112294]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" returned: 0 in 0.851s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:38 devstack sudo[112339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8 Jun 12 05:07:38 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (23df2823-0b2a-4716-8c41-02b91ee77633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf896ca-645e-4daa-9f1a-9ce6d8b6f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf896ca-645e-4daa-9f1a-9ce6d8b6f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543953642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fb035c-16e9-4d53-92a9-cc9765cceb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:39Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9afda25-e0d0-4805-b419-30b44e71f7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9afda25-e0d0-4805-b419-30b44e71f7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5e3ee3-638b-42e7-bbf5-a6d4ebfa1e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5e3ee3-638b-42e7-bbf5-a6d4ebfa1e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fb035c-16e9-4d53-92a9-cc9765cceb3a', 'volume_name': 'volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7cd7a1-4ae4-4236-a0bd-b10a0e562a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7cd7a1-4ae4-4236-a0bd-b10a0e562a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7c5f21-487e-4046-b06b-2a700f76c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:38 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume 98fb035c-16e9-4d53-92a9-cc9765cceb3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a', 'volume_size': 1} Jun 12 05:07:38 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:39 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.info" returned: 0 in 0.723s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.860s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-831050036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a835be2-f463-4c76-ba06-6ccfcf0a3e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:35Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Creating volume 3a835be2-f463-4c76-ba06-6ccfcf0a3e1d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:39 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:39 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d 1073741824 Jun 12 05:07:39 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:39 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-f9cc5bfc-2732-4b0c-85fd-163f0f88f9df tempest-SnapshotDependencyTests-869218687 None] Create snapshot completed successfully Jun 12 05:07:39 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" returned: 0 in 0.611s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-quobyte-fa7ca8a5-1134-41e0-a933-90c9dd5536e8" released by "delete_volume" :: held 1.522s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Created reservations ['8627e5e3-320d-4bc7-9059-e8c03dbd2147', '2a110e81-c3fb-47cb-baac-19f65c80dbc4', '5852cc6b-95c9-4bd2-bc55-01a87a2d6722', 'd67086c2-06c2-45bf-ba65-b3326d086243'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:39 devstack sudo[112345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:39 devstack sudo[112345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:39 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d 1073741824" returned: 0 in 0.750s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:39 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:39 devstack sudo[112350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d Jun 12 05:07:39 devstack sudo[112350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:40 devstack sudo[112345]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.654s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Deleted volume successfully. Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a36d769a-60db-45a2-96ae-4c7a07e16fa2 tempest-VolumeDependencyTests-1262585934 None] Lock "cinder-fa7ca8a5-1134-41e0-a933-90c9dd5536e8-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:40 devstack sudo[112350]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d" returned: 0 in 0.676s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.839s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771087289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf093753-4a55-488c-aede-e2e1b173b1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:36Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Creating volume bf093753-4a55-488c-aede-e2e1b173b1e0 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:40 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:40 devstack sudo[112354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 1073741824 Jun 12 05:07:40 devstack sudo[112354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Flow 'volume_create_manager' (7a990810-038c-41ac-a67d-d64c3b62fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9df7649-aad8-47d7-aa1f-fa14547d6b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc10faa-80f0-46b7-9d56-2df8aecc9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68777749-8c7d-4969-a1ba-1c324d919bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9df7649-aad8-47d7-aa1f-fa14547d6b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39b9a13-c06e-4afe-bef7-226183642701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c9df5b654b4c6293d8e51dae894fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c7e60b7-5008-4df6-898d-c535eacd8c9f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:41Z,use_quota=True,user_id='cd18147e3abf440bbe8f0d6dcc4fa5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccf0239-fc1f-4d1b-9b92-a10a480fac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccf0239-fc1f-4d1b-9b92-a10a480fac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd76d955-ca05-44da-ab2a-f2a441862189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd76d955-ca05-44da-ab2a-f2a441862189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b39b9a13-c06e-4afe-bef7-226183642701', 'volume_name': 'volume-b39b9a13-c06e-4afe-bef7-226183642701', 'volume_size': 1, 'snapshot_id': '4c7e60b7-5008-4df6-898d-c535eacd8c9f'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ae377b-f08f-413c-9c84-9d19b722908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ae377b-f08f-413c-9c84-9d19b722908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f662a2d5-4300-49f1-adc9-4170b4a69748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Volume b39b9a13-c06e-4afe-bef7-226183642701: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b39b9a13-c06e-4afe-bef7-226183642701', 'volume_size': 1, 'snapshot_id': '4c7e60b7-5008-4df6-898d-c535eacd8c9f'} Jun 12 05:07:40 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d (3a835be2-f463-4c76-ba06-6ccfcf0a3e1d): created successfully Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68777749-8c7d-4969-a1ba-1c324d919bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (1954db7b-a808-454a-86bd-7607aadaf756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:40 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:40 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a649c921-cc81-48b3-944f-5b836782e314 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created volume successfully. Jun 12 05:07:41 devstack sudo[112354]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 1073741824" returned: 0 in 0.820s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:41 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:41 devstack sudo[112360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 Jun 12 05:07:41 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:42 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0" returned: 0 in 0.601s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.794s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1568355520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c6f2e0-fa89-4470-acd2-c99f8ca81716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:36Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Creating volume 89c6f2e0-fa89-4470-acd2-c99f8ca81716 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:42 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a32bc-2674-48e7-8324-233f285bdcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf093753-4a55-488c-aede-e2e1b173b1e0', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:42 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 1073741824 Jun 12 05:07:42 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a326ed-f11a-4c43-8fa6-accebb96435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:42 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume volume-bf093753-4a55-488c-aede-e2e1b173b1e0 (bf093753-4a55-488c-aede-e2e1b173b1e0): created successfully Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a326ed-f11a-4c43-8fa6-accebb96435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (9495af89-8ce8-41b4-84c5-ca36d5c7137c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:42 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4b854a56-704e-4461-b7d5-dcc03021c993 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created volume successfully. Jun 12 05:07:42 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 1073741824" returned: 0 in 0.883s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:42 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:43 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 Jun 12 05:07:43 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Flow 'volume_create_manager' (242456bc-cce2-4982-9eb3-cb6c9676c54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dcb08e-d89b-4f14-b524-6ef7460c9354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dcb08e-d89b-4f14-b524-6ef7460c9354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9f8245-c842-421f-873c-c3ccf8557eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827b26761f48463798e8d8e68190818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:43Z,use_quota=True,user_id='b9c911e1d8584a2fabc7e8db9d46653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ddda38-74f6-4389-9981-5bdc7b6e0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ddda38-74f6-4389-9981-5bdc7b6e0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c885941-cd80-4b7e-bf0a-2f6d12f69463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c885941-cd80-4b7e-bf0a-2f6d12f69463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9f8245-c842-421f-873c-c3ccf8557eb1', 'volume_name': 'volume-eb9f8245-c842-421f-873c-c3ccf8557eb1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41235b3-a4e5-4acd-9138-bed24d8e4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41235b3-a4e5-4acd-9138-bed24d8e4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f32901-30e4-4ac2-a3ed-c8346602f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:43 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Volume eb9f8245-c842-421f-873c-c3ccf8557eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9f8245-c842-421f-873c-c3ccf8557eb1', 'volume_size': 1} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:43 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716" returned: 0 in 0.608s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.712s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893828495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece35b7b-03fa-4fb8-b30f-ff5f58604116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:37Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Creating volume ece35b7b-03fa-4fb8-b30f-ff5f58604116 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:43 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76eb9fc-cc1c-404b-835e-2529fe5c98b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b01582e-190d-4494-859e-7ba72a9de57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:43 devstack sudo[112375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 1073741824 Jun 12 05:07:43 devstack sudo[112375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:43 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 (89c6f2e0-fa89-4470-acd2-c99f8ca81716): created successfully Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b01582e-190d-4494-859e-7ba72a9de57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:43 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (105bf722-30e2-4a3b-8193-cd9dd0538767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:43 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e636c5ed-8b57-4405-a257-96e6d13e7aca tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created volume successfully. Jun 12 05:07:44 devstack sudo[112375]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 1073741824" returned: 0 in 0.756s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:44 devstack sudo[112380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 Jun 12 05:07:44 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:44 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116" returned: 0 in 0.578s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.744s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700690655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb724c27-ab6f-467f-9567-3990ab0c8254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a2ee8ff96415cbbf1014a279d38c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:37Z,use_quota=True,user_id='df7d58f672fc45dd8a8cde96d131afbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Creating volume fb724c27-ab6f-467f-9567-3990ab0c8254 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:44 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:44 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:44 devstack sudo[112383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 1073741824 Jun 12 05:07:44 devstack sudo[112383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c4db9e-aef0-41aa-b2bc-571a37858bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6cde62-1ae7-4e3c-9bbf-d87726c3f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:45 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 (ece35b7b-03fa-4fb8-b30f-ff5f58604116): created successfully Jun 12 05:07:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6cde62-1ae7-4e3c-9bbf-d87726c3f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:45 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (3a46cd1f-ea68-4c55-9962-1fd30d5787f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:45 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-145bb0dd-6e77-479a-9a4f-f3c7b8c3cd0a tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created volume successfully. Jun 12 05:07:45 devstack sudo[112383]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 1073741824" returned: 0 in 0.753s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:45 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:45 devstack sudo[112388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 Jun 12 05:07:45 devstack sudo[112388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:46 devstack sudo[112388]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254" returned: 0 in 0.590s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.390s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543953642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fb035c-16e9-4d53-92a9-cc9765cceb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:39Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating volume 98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:46 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62293c9-ca59-454c-96f3-6b1f57100d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb724c27-ab6f-467f-9567-3990ab0c8254', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:46 devstack sudo[112391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a 1073741824 Jun 12 05:07:46 devstack sudo[112391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a4ff0f-53f0-415a-9c3a-8628bcb9a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:46 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Volume volume-fb724c27-ab6f-467f-9567-3990ab0c8254 (fb724c27-ab6f-467f-9567-3990ab0c8254): created successfully Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a4ff0f-53f0-415a-9c3a-8628bcb9a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:46 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Flow 'volume_create_manager' (e832ce9d-0f54-423b-bc99-2a5e0cad4959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:46 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2fe028ae-0e0e-4bae-8748-021eeeef0785 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created volume successfully. Jun 12 05:07:47 devstack sudo[112391]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a 1073741824" returned: 0 in 0.736s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:47 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a Jun 12 05:07:47 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-fb724c27-ab6f-467f-9567-3990ab0c8254-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-fb724c27-ab6f-467f-9567-3990ab0c8254-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-quobyte-fb724c27-ab6f-467f-9567-3990ab0c8254" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-fb724c27-ab6f-467f-9567-3990ab0c8254" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d83e275-e251-4f22-bdd3-f42b1cb5aa7a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:47 devstack sudo[112398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 Jun 12 05:07:47 devstack sudo[112398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:47 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a" returned: 0 in 0.603s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-quobyte-4c7e60b7-5008-4df6-898d-c535eacd8c9f-b39b9a13-c06e-4afe-bef7-226183642701" by "_create_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7c5f21-487e-4046-b06b-2a700f76c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc4a3c0-f099-4d12-9ba4-eecb80413d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-4c7e60b7-5008-4df6-898d-c535eacd8c9f-b39b9a13-c06e-4afe-bef7-226183642701" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Creating volume b39b9a13-c06e-4afe-bef7-226183642701 from snapshot 4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-quobyte-b39b9a13-c06e-4afe-bef7-226183642701" by "_copy_volume_from_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:47 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a (98fb035c-16e9-4d53-92a9-cc9765cceb3a): created successfully Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc4a3c0-f099-4d12-9ba4-eecb80413d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (23df2823-0b2a-4716-8c41-02b91ee77633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-b39b9a13-c06e-4afe-bef7-226183642701" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] snapshot: 4c7e60b7-5008-4df6-898d-c535eacd8c9f, volume: b39b9a13-c06e-4afe-bef7-226183642701, {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 12 05:07:47 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-05edc230-7b4c-4d5f-918a-7ca55353f3c0 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created volume successfully. Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3240ff-abf7-4174-aa0e-2403dd3a7054]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:47 devstack sudo[112398]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254" returned: 0 in 0.706s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:47 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f Jun 12 05:07:47 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:47 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:48 devstack sudo[112406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254 Jun 12 05:07:48 devstack sudo[112406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:48 devstack sudo[112406]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-fb724c27-ab6f-467f-9567-3990ab0c8254" returned: 0 in 0.593s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-fb724c27-ab6f-467f-9567-3990ab0c8254" released by "delete_volume" :: held 1.350s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:48 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f" returned: 0 in 0.758s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20887f11-4f98-4690-aa86-3ff8b9d5830b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Creating direct copy from snapshot {{(pid=92320) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c7b5ac-048e-4f1a-a8e1-b4cc8dc23c0a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created reservations ['27f3e3c2-7c33-4b94-a0f3-7b8d0a69d15f', '00cd5692-964e-4b12-9ab4-3e4482ac25e8', 'c6c37bcb-945e-4128-b6ee-fea611be67b1', 'fafd2e65-3599-4570-846a-115d143bc8c0'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:48 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:48 devstack sudo[112412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:07:48 devstack sudo[112412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:48 devstack sudo[112414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:48 devstack sudo[112414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:49 devstack sudo[112414]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.603s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:49 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Deleted volume successfully. Jun 12 05:07:49 devstack sudo[112412]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.732s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.utils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Path /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 not found in is_blk_device check {{(pid=92320) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-ece35b7b-03fa-4fb8-b30f-ff5f58604116-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:49 devstack sudo[112420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 Jun 12 05:07:49 devstack sudo[112420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3a6d5d84-5353-4315-b5df-d60e6c375a18 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-fb724c27-ab6f-467f-9567-3990ab0c8254-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-ece35b7b-03fa-4fb8-b30f-ff5f58604116-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-quobyte-ece35b7b-03fa-4fb8-b30f-ff5f58604116" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-ece35b7b-03fa-4fb8-b30f-ff5f58604116" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abefad6-5cc8-4d1f-9204-d4d05360ba89]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:49 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:49 devstack sudo[112422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 Jun 12 05:07:49 devstack sudo[112422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:50 devstack sudo[112422]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116" returned: 0 in 0.816s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:50 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:50 devstack sudo[112437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116 Jun 12 05:07:50 devstack sudo[112437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:51 devstack sudo[112437]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-ece35b7b-03fa-4fb8-b30f-ff5f58604116" returned: 0 in 1.255s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-ece35b7b-03fa-4fb8-b30f-ff5f58604116" released by "delete_volume" :: held 2.140s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created reservations ['ccaaa7a5-164d-47f4-82a8-6e1afd35b201', '671e3720-8ce1-43d1-b7fb-d0992eef9417', 'd578f975-8683-4e97-a3a1-1fb310a73fbd', 'b49844a7-d538-48d9-9094-44024608e5ea'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:51 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:51 devstack sudo[112441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:51 devstack sudo[112441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:52 devstack sudo[112441]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:52 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.831s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:52 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:52 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Deleted volume successfully. Jun 12 05:07:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-e0970db8-2924-4807-a76d-394c41c93684 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-ece35b7b-03fa-4fb8-b30f-ff5f58604116-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-89c6f2e0-fa89-4470-acd2-c99f8ca81716-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:52 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-89c6f2e0-fa89-4470-acd2-c99f8ca81716-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-quobyte-89c6f2e0-fa89-4470-acd2-c99f8ca81716" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:53 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-89c6f2e0-fa89-4470-acd2-c99f8ca81716" acquired by "delete_volume" :: waited 0.038s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:53 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[009eaf9f-1672-4e46-a7ff-92fad81f457c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:53 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:53 devstack sudo[112445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 Jun 12 05:07:53 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:54 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716" returned: 0 in 1.240s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:54 devstack sudo[112420]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701" returned: 0 in 5.040s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:54 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0142aaf2-8336-46f1-8b71-13ca3b013aed]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:54 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:54 devstack sudo[112450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716 Jun 12 05:07:54 devstack sudo[112450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:54 devstack sudo[112452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:07:54 devstack sudo[112452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:55 devstack sudo[112450]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-89c6f2e0-fa89-4470-acd2-c99f8ca81716" returned: 0 in 0.583s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-89c6f2e0-fa89-4470-acd2-c99f8ca81716" released by "delete_volume" :: held 1.899s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created reservations ['ab0c3f63-8330-4329-9e29-555989d16ee6', '6011f012-cece-4c9d-b663-495d42562c69', '8ebe8668-08dc-4ca0-bd03-16f6820b2832', '76ef12ab-a5b1-4a12-b197-9414902dec71'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:55 devstack sudo[112457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:55 devstack sudo[112457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-bf093753-4a55-488c-aede-e2e1b173b1e0-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:55 devstack sudo[112452]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.873s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:07:55 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Converted 1024.00 MB image at 203.09 MB/s Jun 12 05:07:55 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 is being set with open permissions: ugo+rw Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-bf093753-4a55-488c-aede-e2e1b173b1e0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:55 devstack sudo[112460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 Jun 12 05:07:55 devstack sudo[112460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-quobyte-bf093753-4a55-488c-aede-e2e1b173b1e0" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-bf093753-4a55-488c-aede-e2e1b173b1e0" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4160f2-946c-4880-8874-462f2a7381cb]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:55 devstack sudo[112462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 Jun 12 05:07:55 devstack sudo[112462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:55 devstack sudo[112457]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.632s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:55 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Deleted volume successfully. Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-1742d36e-7cc0-46fa-8f2e-60e7cdb94df4 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-89c6f2e0-fa89-4470-acd2-c99f8ca81716-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:55 devstack sudo[112460]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701" returned: 0 in 0.594s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-b39b9a13-c06e-4afe-bef7-226183642701" released by "_copy_volume_from_snapshot" :: held 8.105s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-4c7e60b7-5008-4df6-898d-c535eacd8c9f-b39b9a13-c06e-4afe-bef7-226183642701" released by "_create_volume_from_snapshot" :: held 8.152s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.193s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.837s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9f8245-c842-421f-873c-c3ccf8557eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827b26761f48463798e8d8e68190818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:43Z,use_quota=True,user_id='b9c911e1d8584a2fabc7e8db9d46653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Creating volume eb9f8245-c842-421f-873c-c3ccf8557eb1 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:07:55 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:07:55 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:55 devstack sudo[112466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 1073741824 Jun 12 05:07:55 devstack sudo[112466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f662a2d5-4300-49f1-adc9-4170b4a69748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39b9a13-c06e-4afe-bef7-226183642701', 'volume_size': 1, 'snapshot_id': '4c7e60b7-5008-4df6-898d-c535eacd8c9f'}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c65a9d3-5fb4-49d0-9d27-8b91f17960bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:56 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Volume volume-b39b9a13-c06e-4afe-bef7-226183642701 (b39b9a13-c06e-4afe-bef7-226183642701): created successfully Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c65a9d3-5fb4-49d0-9d27-8b91f17960bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Flow 'volume_create_manager' (7a990810-038c-41ac-a67d-d64c3b62fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:56 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-349943f2-b9d2-43d2-91c7-92b773bd8b2c tempest-SnapshotDependencyTests-869218687 None] Created volume successfully. Jun 12 05:07:56 devstack sudo[112462]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0" returned: 0 in 0.757s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:56 devstack sudo[112471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0 Jun 12 05:07:56 devstack sudo[112471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-4c7e60b7-5008-4df6-898d-c535eacd8c9f-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-4c7e60b7-5008-4df6-898d-c535eacd8c9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-quobyte-20887f11-4f98-4690-aa86-3ff8b9d5830b" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-20887f11-4f98-4690-aa86-3ff8b9d5830b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-quobyte-4c7e60b7-5008-4df6-898d-c535eacd8c9f" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-4c7e60b7-5008-4df6-898d-c535eacd8c9f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Deleting offline snapshot 4c7e60b7-5008-4df6-898d-c535eacd8c9f of volume 20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] snapshot_file for this snap is: volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b71dd8-de49-446d-9cc6-b0da1347f29f]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:56 devstack sudo[112471]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-bf093753-4a55-488c-aede-e2e1b173b1e0" returned: 0 in 0.627s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:56 devstack sudo[112466]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-bf093753-4a55-488c-aede-e2e1b173b1e0" released by "delete_volume" :: held 1.435s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 1073741824" returned: 0 in 0.903s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:56 devstack sudo[112478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f Jun 12 05:07:56 devstack sudo[112478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created reservations ['8c4680c0-2b27-4975-b756-3215c8a3f10a', '6452380d-08f8-46e1-9b54-7f33be54c5d3', 'd8c098c7-5f7b-4e55-b286-262804ed593d', '0535b218-1800-480a-9761-d0c62dfbb2b6'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:56 devstack sudo[112480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 Jun 12 05:07:56 devstack sudo[112480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:56 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:57 devstack sudo[112482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:57 devstack sudo[112482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:57 devstack sudo[112480]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1" returned: 0 in 0.591s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.796s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f32901-30e4-4ac2-a3ed-c8346602f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9f8245-c842-421f-873c-c3ccf8557eb1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dae2750-700a-4554-b949-8b6a9fd9bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating offline snapshot 4704e5fd-c6d0-494e-8d22-3e962b5ce752 of volume 98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:07:57 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Volume volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 (eb9f8245-c842-421f-873c-c3ccf8557eb1): created successfully Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dae2750-700a-4554-b949-8b6a9fd9bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:57 devstack sudo[112478]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Flow 'volume_create_manager' (242456bc-cce2-4982-9eb3-cb6c9676c54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d100b88-6960-43c8-8e1c-2475f30a0f83]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f" returned: 0 in 0.822s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20887f11-4f98-4690-aa86-3ff8b9d5830b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:07:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d0d84e4d-f261-40f2-9453-9d94fc05440b tempest-CinderUnicodeTest-1013269606 None] Created volume successfully. Jun 12 05:07:57 devstack sudo[112482]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b129eac-a75a-4a6b-b14c-ae68f001733b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.683s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:07:57 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Deleted volume successfully. Jun 12 05:07:57 devstack sudo[112489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a Jun 12 05:07:57 devstack sudo[112489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-ed872f38-55d7-4302-b833-4b926564f443 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-bf093753-4a55-488c-aede-e2e1b173b1e0-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-quobyte-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d" acquired by "delete_volume" :: waited 0.030s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:57 devstack sudo[112490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:07:57 devstack sudo[112490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7b372-0ba3-4628-ba6f-4b2c1fcc8a94]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:07:57 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:57 devstack sudo[112493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d Jun 12 05:07:57 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:58 devstack sudo[112489]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a" returned: 0 in 0.758s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:58 devstack sudo[112504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 1G Jun 12 05:07:58 devstack sudo[112504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:58 devstack sudo[112490]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.748s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:58 devstack sudo[112508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f Jun 12 05:07:58 devstack sudo[112508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:58 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d" returned: 0 in 0.767s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:58 devstack sudo[112511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d Jun 12 05:07:58 devstack sudo[112511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Flow 'volume_create_manager' (15895ad2-b19e-43f4-8dea-9768835cb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7722146-854b-4f5f-a878-39a486f1f30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7722146-854b-4f5f-a878-39a486f1f30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1730061126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea08172-3910-4e5a-927a-f2685704de8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827b26761f48463798e8d8e68190818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:59Z,use_quota=True,user_id='b9c911e1d8584a2fabc7e8db9d46653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9db07f-a213-4e8b-9fc3-f67880bfcfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9db07f-a213-4e8b-9fc3-f67880bfcfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9719c7bc-5ac2-4ed0-9ad4-09cd0a506e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9719c7bc-5ac2-4ed0-9ad4-09cd0a506e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea08172-3910-4e5a-927a-f2685704de8d', 'volume_name': 'volume-7ea08172-3910-4e5a-927a-f2685704de8d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39226d22-ec18-46ca-a8d7-91c72e3e4ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39226d22-ec18-46ca-a8d7-91c72e3e4ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9487eb-dec1-4b8b-b76b-0affaf995db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:07:58 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Volume 7ea08172-3910-4e5a-927a-f2685704de8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea08172-3910-4e5a-927a-f2685704de8d', 'volume_size': 1} Jun 12 05:07:58 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:59 devstack sudo[112504]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 1G" returned: 0 in 0.837s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:59 devstack sudo[112521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 Jun 12 05:07:59 devstack sudo[112521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:59 devstack sudo[112511]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d" returned: 0 in 0.685s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d" released by "delete_volume" :: held 1.497s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=121,cinder:UPDATE=163,cinder:DELETE=15,cinder:INSERT=38 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:07:59 devstack sudo[112508]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f" returned: 0 in 0.899s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created reservations ['356abbe4-eb7c-4f62-9d03-0795bb08f328', '99165716-dab0-49a4-b4c8-de18d297e0c6', '6b8c0aaf-7847-441a-965b-843afb8bc897', 'a755067b-cc37-40a9-bd48-caf43c009aa7'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:07:59 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f Jun 12 05:07:59 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:59 devstack sudo[112525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:07:59 devstack sudo[112525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:59 devstack sudo[112521]: pam_unix(sudo:session): session closed for user root Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752" returned: 0 in 0.672s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:07:59 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 is being set with open permissions: ugo+rw Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:07:59 devstack sudo[112532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 Jun 12 05:07:59 devstack sudo[112532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-99069a49-1ba1-474f-8302-f738d42a68f9-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-99069a49-1ba1-474f-8302-f738d42a68f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:07:59 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=164,cinder:SELECT=124,cinder:INSERT=46,cinder:DELETE=17 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:08:00 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "cinder-quobyte-99069a49-1ba1-474f-8302-f738d42a68f9" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b.4c7e60b7-5008-4df6-898d-c535eacd8c9f" returned: 0 in 0.711s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:00 devstack sudo[112525]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.656s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-4c7e60b7-5008-4df6-898d-c535eacd8c9f" released by "_delete_snapshot" :: held 3.301s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-99069a49-1ba1-474f-8302-f738d42a68f9" acquired by "delete_volume" :: waited 0.052s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Deleted volume successfully. Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-20887f11-4f98-4690-aa86-3ff8b9d5830b" released by "delete_snapshot" :: held 3.341s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f582a3f-30a7-42b9-8fed-bec13d371875]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-d861e568-254c-4605-a5a2-62b52d22277b tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-3a835be2-f463-4c76-ba06-6ccfcf0a3e1d-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Created reservations ['7330ebae-3ab9-4384-ac23-16fc9bf0ca92', '893de289-624e-4c2d-9941-50850e1440f6', 'b63e3f48-b90a-41bd-8761-721289f91870', '34b9540e-1e4f-402d-a18c-defe8e120748'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:00 devstack sudo[112535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 Jun 12 05:08:00 devstack sudo[112535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:00 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Delete snapshot completed successfully. Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-97a4029c-43c1-4e52-90d1-edd386057d10 tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-4c7e60b7-5008-4df6-898d-c535eacd8c9f-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:00 devstack sudo[112532]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752" returned: 0 in 0.639s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:00 devstack sudo[112538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info Jun 12 05:08:00 devstack sudo[112538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:00 devstack sudo[112535]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9" returned: 0 in 0.756s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:00 devstack sudo[112543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9 Jun 12 05:08:00 devstack sudo[112543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:00 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-20887f11-4f98-4690-aa86-3ff8b9d5830b-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-20887f11-4f98-4690-aa86-3ff8b9d5830b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-quobyte-20887f11-4f98-4690-aa86-3ff8b9d5830b" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-20887f11-4f98-4690-aa86-3ff8b9d5830b" acquired by "delete_volume" :: waited 0.023s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76b58a-58e3-4922-a7b7-976e72546550]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:01 devstack sudo[112538]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info" returned: 0 in 0.636s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:01 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info is being set with open permissions: ugo+rw Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:01 devstack sudo[112547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info Jun 12 05:08:01 devstack sudo[112547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:01 devstack sudo[112546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:08:01 devstack sudo[112546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:01 devstack sudo[112543]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-99069a49-1ba1-474f-8302-f738d42a68f9" returned: 0 in 0.616s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-quobyte-99069a49-1ba1-474f-8302-f738d42a68f9" released by "delete_volume" :: held 1.423s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Created reservations ['cb10a16f-cbd7-4dd4-a50f-f697b7a8b76d', '49afc14b-b94d-4f66-adb5-36dadd66ba35', '07d87338-ae1d-487c-8c70-6811bfe27707', 'f7d16d05-be8f-4d92-a53e-4d6093f7b885'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:01 devstack sudo[112551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:01 devstack sudo[112551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:01 devstack sudo[112547]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.info" returned: 0 in 0.582s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:07:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1730061126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea08172-3910-4e5a-927a-f2685704de8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827b26761f48463798e8d8e68190818b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:07:59Z,use_quota=True,user_id='b9c911e1d8584a2fabc7e8db9d46653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Creating volume 7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:01 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:01 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d 1073741824 Jun 12 05:08:01 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:01 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-468788ba-4e3d-4689-a77f-609742e2970e tempest-CreateVolumesFromSnapshotTest-415560743 None] Create snapshot completed successfully Jun 12 05:08:01 devstack sudo[112546]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.763s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:01 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:01 devstack sudo[112560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b Jun 12 05:08:01 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:02 devstack sudo[112551]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.669s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:02 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Deleted volume successfully. Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9c287bed-f77e-4da3-b013-f95ae775ae84 tempest-CreateVolumesFromSourceVolumeTest-638053136 None] Lock "cinder-99069a49-1ba1-474f-8302-f738d42a68f9-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:02 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-20887f11-4f98-4690-aa86-3ff8b9d5830b" returned: 0 in 0.747s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-20887f11-4f98-4690-aa86-3ff8b9d5830b" released by "delete_volume" :: held 1.582s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Created reservations ['27ede07e-3947-4c5e-a73e-67a58b61ad53', '10fe7a14-7788-4e96-97e3-869a11c1cf88', '089da15c-b6e2-458c-b415-05420455fb7c', '2d9a4ea8-69e1-47d4-8cf7-a3a51cf6eda2'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:08:02 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (8628b407-2a13-4606-b736-64e1f6a5d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7ce3be-3089-416a-a56d-d859b91bb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d 1073741824" returned: 0 in 1.059s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7ce3be-3089-416a-a56d-d859b91bb194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851943737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8898b709-412f-4873-9a71-2e029fd3bef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:03Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a35312-2ea6-4098-8067-5dccf956a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a35312-2ea6-4098-8067-5dccf956a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7099edb2-8e12-47f8-9e59-a3a4f4a8f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7099edb2-8e12-47f8-9e59-a3a4f4a8f854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8898b709-412f-4873-9a71-2e029fd3bef1', 'volume_name': 'volume-8898b709-412f-4873-9a71-2e029fd3bef1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ec7ce9-4cfe-4dd3-abb2-9d9cc0a1bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ec7ce9-4cfe-4dd3-abb2-9d9cc0a1bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af611bc8-3d77-4167-9a79-5da2a807ce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:02 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume 8898b709-412f-4873-9a71-2e029fd3bef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8898b709-412f-4873-9a71-2e029fd3bef1', 'volume_size': 1} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:02 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:02 devstack sudo[112567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d Jun 12 05:08:02 devstack sudo[112567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:03 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:03 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (b002435e-8568-458a-bece-5cb5710e6e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31631a0c-75d9-43cb-b236-c3cc71629ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-b39b9a13-c06e-4afe-bef7-226183642701-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31631a0c-75d9-43cb-b236-c3cc71629ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123308138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1293fe51-c639-4d79-b537-9f99e22e8e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:03Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de7919b-0921-42f7-9763-5cf88351c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de7919b-0921-42f7-9763-5cf88351c992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4601311f-1cf5-43f6-825d-639eb70a4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4601311f-1cf5-43f6-825d-639eb70a4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1293fe51-c639-4d79-b537-9f99e22e8e91', 'volume_name': 'volume-1293fe51-c639-4d79-b537-9f99e22e8e91', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac38fe6-79b6-4ece-a02a-ef8cb373c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac38fe6-79b6-4ece-a02a-ef8cb373c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1664e11-2b66-4948-a54d-5e7ad6b2c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:03 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume 1293fe51-c639-4d79-b537-9f99e22e8e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1293fe51-c639-4d79-b537-9f99e22e8e91', 'volume_size': 1} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-b39b9a13-c06e-4afe-bef7-226183642701-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "cinder-quobyte-b39b9a13-c06e-4afe-bef7-226183642701" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-b39b9a13-c06e-4afe-bef7-226183642701" acquired by "delete_volume" :: waited 0.042s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a4b10d-0149-42af-8716-92e92a88ceed]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:03 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.909s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:03 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Deleted volume successfully. Jun 12 05:08:03 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 Jun 12 05:08:03 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:03 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-14b4554c-2302-4923-8438-812c8469dc2b tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-20887f11-4f98-4690-aa86-3ff8b9d5830b-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (50a54af4-a32e-4f29-a720-6acc8b63959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:04 devstack sudo[112567]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87dc805-e85e-4de9-abd7-baa1eb1d7d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d" returned: 0 in 1.135s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851943737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8898b709-412f-4873-9a71-2e029fd3bef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:03Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating volume 8898b709-412f-4873-9a71-2e029fd3bef1 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:04 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87dc805-e85e-4de9-abd7-baa1eb1d7d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2043876800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70d2469-15a1-4f0c-a88d-08fb9cb125ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:04Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack sudo[112576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 1073741824 Jun 12 05:08:04 devstack sudo[112576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920fe0e6-b63a-4f3c-9146-3572a86f21f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920fe0e6-b63a-4f3c-9146-3572a86f21f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed18dc3c-8ef5-4fa0-8539-733ae1ff4f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed18dc3c-8ef5-4fa0-8539-733ae1ff4f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70d2469-15a1-4f0c-a88d-08fb9cb125ef', 'volume_name': 'volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7aac22-635b-4a75-9f57-2b7cc98d7a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7aac22-635b-4a75-9f57-2b7cc98d7a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc66675-7acc-45a1-b6c3-d57f96f966b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume b70d2469-15a1-4f0c-a88d-08fb9cb125ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef', 'volume_size': 1} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9487eb-dec1-4b8b-b76b-0affaf995db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea08172-3910-4e5a-927a-f2685704de8d', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08155c3e-5bea-468a-bc8a-ced5ee86a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Volume volume-7ea08172-3910-4e5a-927a-f2685704de8d (7ea08172-3910-4e5a-927a-f2685704de8d): created successfully Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08155c3e-5bea-468a-bc8a-ced5ee86a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Flow 'volume_create_manager' (15895ad2-b19e-43f4-8dea-9768835cb40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:04 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-42a20dc9-e02d-4ce2-98e7-53916a135945 tempest-CinderUnicodeTest-1013269606 None] Created volume successfully. Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (17764db7-cbe5-41af-9ecd-13f2bc85763d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f53f9a-98a0-4022-84cf-d3f5a769cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f53f9a-98a0-4022-84cf-d3f5a769cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965577860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd01dfb-d0e8-40b5-862b-363bfcbf96e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:05Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cf874a-7fca-4ec0-b301-2ecf497fab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cf874a-7fca-4ec0-b301-2ecf497fab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324d24d4-f701-4b0c-ba70-7fd0fbd38316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324d24d4-f701-4b0c-ba70-7fd0fbd38316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd01dfb-d0e8-40b5-862b-363bfcbf96e2', 'volume_name': 'volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97063ca8-be72-49ff-8ff9-455dee2cf071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97063ca8-be72-49ff-8ff9-455dee2cf071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113e99fc-afc7-4521-85e4-1743f06b0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:04 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume 3fd01dfb-d0e8-40b5-862b-363bfcbf96e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2', 'volume_size': 1} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:04 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701" returned: 0 in 1.077s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:04 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:04 devstack sudo[112581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701 Jun 12 05:08:04 devstack sudo[112581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (d54c3497-1b8e-480b-8862-f7da352888af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1778ce-2f9a-48cc-bb36-66c334f1a49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1778ce-2f9a-48cc-bb36-66c334f1a49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123464375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9194b4-1e0c-4267-a466-63d397f09865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:05Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71664cb-3714-452c-be8b-888b20eb80a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71664cb-3714-452c-be8b-888b20eb80a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be44f8f-0b43-4aea-967a-61533253ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be44f8f-0b43-4aea-967a-61533253ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9194b4-1e0c-4267-a466-63d397f09865', 'volume_name': 'volume-0b9194b4-1e0c-4267-a466-63d397f09865', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f25b61f-bd24-485b-9926-ff08a9d8a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f25b61f-bd24-485b-9926-ff08a9d8a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72df322-0e35-4b14-a1cb-62afe70358ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:05 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume 0b9194b4-1e0c-4267-a466-63d397f09865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9194b4-1e0c-4267-a466-63d397f09865', 'volume_size': 1} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:05 devstack sudo[112576]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 1073741824" returned: 0 in 1.145s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:05 devstack sudo[112586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 Jun 12 05:08:05 devstack sudo[112586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:05 devstack sudo[112581]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b39b9a13-c06e-4afe-bef7-226183642701" returned: 0 in 0.765s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-quobyte-b39b9a13-c06e-4afe-bef7-226183642701" released by "delete_volume" :: held 1.920s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Created reservations ['325aabd5-d063-4f5a-b141-730d3e374160', 'fea26496-a294-4207-9f97-9535348005eb', '51d8bdf5-52ec-43a2-8e93-c161e25bd737', 'e0814bad-da55-438f-ab01-a02f0d6d3c36'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:05 devstack sudo[112589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:05 devstack sudo[112589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:05 devstack sudo[112586]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1" returned: 0 in 0.702s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.449s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123308138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1293fe51-c639-4d79-b537-9f99e22e8e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:03Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating volume 1293fe51-c639-4d79-b537-9f99e22e8e91 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:05 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:05 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:06 devstack sudo[112592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 1073741824 Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af611bc8-3d77-4167-9a79-5da2a807ce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8898b709-412f-4873-9a71-2e029fd3bef1', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:06 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0fd174-d497-4d3a-96a3-52cfdc99c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:06 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume volume-8898b709-412f-4873-9a71-2e029fd3bef1 (8898b709-412f-4873-9a71-2e029fd3bef1): created successfully Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0fd174-d497-4d3a-96a3-52cfdc99c6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (8628b407-2a13-4606-b736-64e1f6a5d190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a18d3996-c089-49e5-9a8f-2864d78c39fe tempest-CreateVolumesFromSnapshotTest-415560743 None] Created volume successfully. Jun 12 05:08:06 devstack sudo[112589]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.617s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:06 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Deleted volume successfully. Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-91ff1690-643b-44ed-9ce2-0f15c2c503fc tempest-SnapshotDependencyTests-869218687 None] Lock "cinder-b39b9a13-c06e-4afe-bef7-226183642701-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:06 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 1073741824" returned: 0 in 0.884s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:06 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:06 devstack sudo[112599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 Jun 12 05:08:06 devstack sudo[112599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:07 devstack sudo[112599]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91" returned: 0 in 0.693s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.402s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2043876800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70d2469-15a1-4f0c-a88d-08fb9cb125ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:04Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating volume b70d2469-15a1-4f0c-a88d-08fb9cb125ef {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:07 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:07 devstack sudo[112603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef 1073741824 Jun 12 05:08:07 devstack sudo[112603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1664e11-2b66-4948-a54d-5e7ad6b2c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1293fe51-c639-4d79-b537-9f99e22e8e91', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6b9b14-545a-415b-a0fd-7af6938475f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:07 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume volume-1293fe51-c639-4d79-b537-9f99e22e8e91 (1293fe51-c639-4d79-b537-9f99e22e8e91): created successfully Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6b9b14-545a-415b-a0fd-7af6938475f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:07 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (b002435e-8568-458a-bece-5cb5710e6e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:07 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-cf743274-c048-45ce-bdce-0c9a47dadee9 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created volume successfully. Jun 12 05:08:08 devstack sudo[112603]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef 1073741824" returned: 0 in 0.899s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:08 devstack sudo[112610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef Jun 12 05:08:08 devstack sudo[112610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92320) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Flow 'volume_create_manager' (b3971a4a-ccce-4e7c-bc36-cd57c3e7e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9b1d6d-e16a-4144-a680-8c3ec93d2ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9b1d6d-e16a-4144-a680-8c3ec93d2ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8b7d28-ee64-4343-9a47-00e0c6ba0c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d39aa1cfed4e86893575d0ec41139c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:09Z,use_quota=True,user_id='40f4bd74318a48c1bcf8f6abaae06af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b028c73-b8d4-466b-82d4-0f15fad4ffbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b028c73-b8d4-466b-82d4-0f15fad4ffbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea93b79-e39f-4bad-868f-602c27364bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:08 devstack cinder-volume[92320]: DEBUG cinder.image.glance [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Creating Keystone auth plugin from conf {{(pid=92320) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 12 05:08:09 devstack sudo[112610]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef" returned: 0 in 0.643s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.484s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965577860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd01dfb-d0e8-40b5-862b-363bfcbf96e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:05Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating volume 3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:09 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:09 devstack sudo[112613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 1073741824 Jun 12 05:08:09 devstack sudo[112613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc66675-7acc-45a1-b6c3-d57f96f966b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691b8458-910d-4ed2-99ef-683f384247c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea93b79-e39f-4bad-868f-602c27364bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf8b7d28-ee64-4343-9a47-00e0c6ba0c16', 'volume_name': 'volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16', 'volume_size': 1, 'image_id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7378f7a9-2187-44ac-877f-b364759c73c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c044c4cf8cc4daff2969d4a83cb582d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43d39aa1cfed4e86893575d0ec41139c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98d6c9e730daf5b7430d9517df66f798fc4e8768312d9e6f92068c342bb93b6b39cbe78dccdf48cb3ad4df5395539dca4cb82c9367b5f239a9c98cb2f5feedd2', 'id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'created_at': datetime.datetime(2026, 6, 12, 3, 8, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 8, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7378f7a9-2187-44ac-877f-b364759c73c2/file', 'properties': {}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7041e7-f132-47c2-b651-aa7b48a403f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7041e7-f132-47c2-b651-aa7b48a403f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6282e9-48a9-4eba-9a31-50dade260de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Volume cf8b7d28-ee64-4343-9a47-00e0c6ba0c16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16', 'volume_size': 1, 'image_id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7378f7a9-2187-44ac-877f-b364759c73c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c044c4cf8cc4daff2969d4a83cb582d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43d39aa1cfed4e86893575d0ec41139c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98d6c9e730daf5b7430d9517df66f798fc4e8768312d9e6f92068c342bb93b6b39cbe78dccdf48cb3ad4df5395539dca4cb82c9367b5f239a9c98cb2f5feedd2', 'id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'created_at': datetime.datetime(2026, 6, 12, 3, 8, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 8, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7378f7a9-2187-44ac-877f-b364759c73c2/file', 'properties': {}}, 'image_service': } Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Trying to clone cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 from image 7378f7a9-2187-44ac-877f-b364759c73c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7378f7a9-2187-44ac-877f-b364759c73c2', 'metadata': {}}]). {{(pid=92320) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 12 05:08:09 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef (b70d2469-15a1-4f0c-a88d-08fb9cb125ef): created successfully Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691b8458-910d-4ed2-99ef-683f384247c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (50a54af4-a32e-4f29-a720-6acc8b63959d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:09 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2d141beb-c2ba-41c8-940c-f40242b76e39 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created volume successfully. Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 12 05:08:09 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Image download 0.00 MB at 0.00 MB/s Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b90043-16b6-4440-b4be-c246c37c0ebe]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:09 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:09 devstack sudo[112615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD Jun 12 05:08:09 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:10 devstack sudo[112613]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 1073741824" returned: 0 in 0.958s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:10 devstack sudo[112623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 Jun 12 05:08:10 devstack sudo[112623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:10 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:10 devstack sudo[112625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD Jun 12 05:08:10 devstack sudo[112625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:10 devstack sudo[112623]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.747s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123464375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9194b4-1e0c-4267-a466-63d397f09865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a609582f3d5345eb9d6d43ce571ac964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:05Z,use_quota=True,user_id='f0b64da9c81b4819b0e5476f59e36b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Creating volume 0b9194b4-1e0c-4267-a466-63d397f09865 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:10 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:10 devstack sudo[112629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 1073741824 Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113e99fc-afc7-4521-85e4-1743f06b0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:10 devstack sudo[112629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdee18d-5efe-4ac0-b55c-7495ef63393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:10 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 (3fd01dfb-d0e8-40b5-862b-363bfcbf96e2): created successfully Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdee18d-5efe-4ac0-b55c-7495ef63393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:10 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (17764db7-cbe5-41af-9ecd-13f2bc85763d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:11 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-8b11f1bf-462a-47b6-af84-3250f2711bde tempest-CreateVolumesFromSnapshotTest-415560743 None] Created volume successfully. Jun 12 05:08:11 devstack sudo[112625]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Temporary image 7378f7a9-2187-44ac-877f-b364759c73c2 is fetched for user 40f4bd74318a48c1bcf8f6abaae06af1. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d496a-6218-4315-8453-d9ddef3de126]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:11 devstack sudo[112634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD Jun 12 05:08:11 devstack sudo[112634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:11 devstack sudo[112629]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 1073741824" returned: 0 in 0.919s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:11 devstack sudo[112634]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:11 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:11 devstack sudo[112641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 Jun 12 05:08:11 devstack sudo[112641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:12 devstack sudo[112642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD Jun 12 05:08:12 devstack sudo[112642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:12 devstack sudo[112641]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865" returned: 0 in 0.619s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.918s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72df322-0e35-4b14-a1cb-62afe70358ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9194b4-1e0c-4267-a466-63d397f09865', 'volume_size': 1}' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051c4862-5420-402e-ae7b-874666a0b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Creating offline snapshot 2ccca974-5744-47fc-9243-1bcdc162875b of volume 7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 12 05:08:12 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Volume volume-0b9194b4-1e0c-4267-a466-63d397f09865 (0b9194b4-1e0c-4267-a466-63d397f09865): created successfully Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051c4862-5420-402e-ae7b-874666a0b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Flow 'volume_create_manager' (d54c3497-1b8e-480b-8862-f7da352888af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e5d80-a424-4ea0-97f5-c4aee0d8342c]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:12 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-79f0a07a-ccfd-4792-9414-fb497dc3286f tempest-CreateVolumesFromSnapshotTest-415560743 None] Created volume successfully. Jun 12 05:08:12 devstack sudo[112642]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD" returned: 1 in 0.742s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:12 devstack sudo[112650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d Jun 12 05:08:12 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-0b9194b4-1e0c-4267-a466-63d397f09865-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:12 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-0b9194b4-1e0c-4267-a466-63d397f09865-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-0b9194b4-1e0c-4267-a466-63d397f09865" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-0b9194b4-1e0c-4267-a466-63d397f09865" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5500795-b383-4463-97c9-5b6336688515]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:13 devstack sudo[112652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 Jun 12 05:08:13 devstack sudo[112652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:13 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:13 devstack sudo[112658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b 1G Jun 12 05:08:13 devstack sudo[112658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:13 devstack sudo[112652]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865" returned: 0 in 0.849s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:13 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:13 devstack sudo[112665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865 Jun 12 05:08:13 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:14 devstack sudo[112658]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b 1G" returned: 0 in 0.909s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea08172-3910-4e5a-927a-f2685704de8d -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:14 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea08172-3910-4e5a-927a-f2685704de8d -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b Jun 12 05:08:14 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:14 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-0b9194b4-1e0c-4267-a466-63d397f09865" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-0b9194b4-1e0c-4267-a466-63d397f09865" released by "delete_volume" :: held 1.579s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['5cfc4a53-8772-42c6-8924-f08916eb89f3', '38deb9b7-cb2b-4bc7-9fe6-62e50f53ecf8', 'c28077f5-78c9-488f-a73d-6ea4a2bb8cc8', 'a4e03386-8bf0-49fd-b677-5fb971c2d960'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:14 devstack sudo[112674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:14 devstack sudo[112674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:14 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea08172-3910-4e5a-927a-f2685704de8d -F qcow2 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b" returned: 0 in 0.739s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:14 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b is being set with open permissions: ugo+rw Jun 12 05:08:14 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:15 devstack sudo[112679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b Jun 12 05:08:15 devstack sudo[112679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2" acquired by "delete_volume" :: waited 0.035s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f673ec-aaf9-4de4-8836-6e19c791a519]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:15 devstack sudo[112674]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.714s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:15 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleted volume successfully. Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b4244ef3-c177-4d39-9bbc-bfafcb232071 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-0b9194b4-1e0c-4267-a466-63d397f09865-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:15 devstack sudo[112682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 Jun 12 05:08:15 devstack sudo[112682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:15 devstack sudo[112679]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b" returned: 0 in 0.786s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:15 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:15 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info Jun 12 05:08:15 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:16 devstack sudo[112682]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2" returned: 0 in 0.825s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:16 devstack sudo[112690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2 Jun 12 05:08:16 devstack sudo[112690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:16 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info" returned: 0 in 0.665s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:16 devstack cinder-volume[92320]: WARNING cinder.volume.drivers.remotefs [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info is being set with open permissions: ugo+rw Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:16 devstack sudo[112693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info Jun 12 05:08:16 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:16 devstack sudo[112690]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2" returned: 0 in 0.647s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2" released by "delete_volume" :: held 1.539s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:16 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['0c1b7343-ebe4-4436-8476-6d35da429f4c', '393ede60-0485-4305-a29b-d57d18fe765c', 'e1ef37b3-f707-42e1-a377-49794248d175', '3432d578-a393-4e3f-b7c3-1227b4512bae'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:17 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.info" returned: 0 in 0.588s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:17 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:17 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.454s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-12T03:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8b7d28-ee64-4343-9a47-00e0c6ba0c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d39aa1cfed4e86893575d0ec41139c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-12T03:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-12T03:08:09Z,use_quota=True,user_id='40f4bd74318a48c1bcf8f6abaae06af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7683221-fcb3-4ce0-8eb4-0c3132878423),volume_type_id=d7683221-fcb3-4ce0-8eb4-0c3132878423)}" {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Creating volume cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Selected osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 as target Quobyte volume. {{(pid=92320) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 12 05:08:17 devstack cinder-volume[92320]: INFO cinder.volume.drivers.remotefs [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] casted to osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52 Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 1073741824 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:17 devstack sudo[112699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 1073741824 Jun 12 05:08:17 devstack sudo[112699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-ba7c5882-6682-494d-90b3-d1b5ed312d1c tempest-CinderUnicodeTest-1013269606 None] Create snapshot completed successfully Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-b70d2469-15a1-4f0c-a88d-08fb9cb125ef-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-b70d2469-15a1-4f0c-a88d-08fb9cb125ef-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-b70d2469-15a1-4f0c-a88d-08fb9cb125ef" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-b70d2469-15a1-4f0c-a88d-08fb9cb125ef" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a245c74-db2d-45f7-aed3-a4d35ac90b3b]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:17 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.642s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:17 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleted volume successfully. Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a58ef36c-04f2-47c5-a425-7dc3cb5b3254 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-3fd01dfb-d0e8-40b5-862b-363bfcbf96e2-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:17 devstack sudo[112704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef Jun 12 05:08:17 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:17 devstack sudo[112699]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 1073741824" returned: 0 in 0.794s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:17 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:17 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:17 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-2ccca974-5744-47fc-9243-1bcdc162875b-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-2ccca974-5744-47fc-9243-1bcdc162875b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-quobyte-7ea08172-3910-4e5a-927a-f2685704de8d" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-7ea08172-3910-4e5a-927a-f2685704de8d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-quobyte-2ccca974-5744-47fc-9243-1bcdc162875b" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-2ccca974-5744-47fc-9243-1bcdc162875b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Deleting offline snapshot 2ccca974-5744-47fc-9243-1bcdc162875b of volume 7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] snapshot_file for this snap is: volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b4279-9663-4de9-8423-3d045ed71fd5]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:18 devstack sudo[112709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b Jun 12 05:08:18 devstack sudo[112709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:18 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef" returned: 0 in 0.760s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:18 devstack sudo[112714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef Jun 12 05:08:18 devstack sudo[112714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:18 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 0 in 0.678s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'} {{(pid=92320) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Attempting download of 7378f7a9-2187-44ac-877f-b364759c73c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/7378f7a9-2187-44ac-877f-b364759c73c2', 'metadata': {}}])) to volume cf8b7d28-ee64-4343-9a47-00e0c6ba0c16. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e56a44-c523-4f54-b099-d44d90ceea1f]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:18 devstack sudo[112717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m Jun 12 05:08:18 devstack sudo[112717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:18 devstack sudo[112709]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b" returned: 0 in 0.713s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea08172-3910-4e5a-927a-f2685704de8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6232a-084a-46d3-a26f-849dc8038b36]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:18 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:19 devstack sudo[112722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d Jun 12 05:08:19 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:19 devstack sudo[112714]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-b70d2469-15a1-4f0c-a88d-08fb9cb125ef" returned: 0 in 0.635s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-b70d2469-15a1-4f0c-a88d-08fb9cb125ef" released by "delete_volume" :: held 1.443s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['4bfcb3c1-ab15-46cd-ba2c-dbca8f9a7f37', 'b72fbd81-9296-4b28-8e77-b6d9e9ad87cb', '7dfb8604-71ca-4a7c-9697-61546da0c300', '557ba36f-d650-4354-819f-a97719825141'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:19 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:19 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:19 devstack sudo[112717]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m" returned: 0 in 0.711s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:19 devstack sudo[112729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m Jun 12 05:08:19 devstack sudo[112729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:19 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d" returned: 0 in 0.742s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:19 devstack sudo[112739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b Jun 12 05:08:19 devstack sudo[112739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-1293fe51-c639-4d79-b537-9f99e22e8e91-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-1293fe51-c639-4d79-b537-9f99e22e8e91-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:19 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.669s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:19 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleted volume successfully. Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-1293fe51-c639-4d79-b537-9f99e22e8e91" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-1293fe51-c639-4d79-b537-9f99e22e8e91" acquired by "delete_volume" :: waited 0.022s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-3ff6a207-5673-4852-93c3-018242057a54 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-b70d2469-15a1-4f0c-a88d-08fb9cb125ef-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601ae23-79ca-459b-937e-4762de3c35d3]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:19 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:20 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 Jun 12 05:08:20 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:20 devstack sudo[112729]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m" returned: 1 in 0.816s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7378f7a9-2187-44ac-877f-b364759c73c2_7pupim2m' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cae85df-6d79-40c5-93df-98bf5e052739]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:20 devstack sudo[112749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD Jun 12 05:08:20 devstack sudo[112749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:20 devstack sudo[112739]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b" returned: 0 in 0.762s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:20 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b Jun 12 05:08:20 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:20 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91" returned: 0 in 0.738s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:20 devstack sudo[112758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91 Jun 12 05:08:20 devstack sudo[112758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:20 devstack sudo[112749]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:20 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:21 devstack sudo[112763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD Jun 12 05:08:21 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:21 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d.2ccca974-5744-47fc-9243-1bcdc162875b" returned: 0 in 0.653s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-2ccca974-5744-47fc-9243-1bcdc162875b" released by "_delete_snapshot" :: held 2.985s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-7ea08172-3910-4e5a-927a-f2685704de8d" released by "delete_snapshot" :: held 3.008s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Created reservations ['68013e8c-a9e1-4311-86c1-223f620c2c6b', '52058bc6-7b7a-4350-9513-8da0804fdd68', 'd92b3db5-c192-40ae-8bda-5b1639795471', 'bd6f6985-96fb-461a-bdb3-50add9033f81'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:21 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Delete snapshot completed successfully. Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-4036c9d5-7cee-4bd7-9b18-0686029202e0 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-2ccca974-5744-47fc-9243-1bcdc162875b-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-7ea08172-3910-4e5a-927a-f2685704de8d-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-7ea08172-3910-4e5a-927a-f2685704de8d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:21 devstack sudo[112758]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-1293fe51-c639-4d79-b537-9f99e22e8e91" returned: 0 in 0.636s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-1293fe51-c639-4d79-b537-9f99e22e8e91" released by "delete_volume" :: held 1.436s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-quobyte-7ea08172-3910-4e5a-927a-f2685704de8d" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-7ea08172-3910-4e5a-927a-f2685704de8d" acquired by "delete_volume" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc04e2-76d9-489f-922f-d27f51075824]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['686b81f6-c67b-4be4-b7c7-0e033ee2be6f', '46762e05-cbfc-45e6-8dde-ad2bcaa2d49f', '31b17bb7-e410-410a-a1fe-a4654c62da86', '9b82012c-9e1b-41a7-93aa-71c13608a5ff'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:21 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d Jun 12 05:08:21 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:21 devstack sudo[112767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:21 devstack sudo[112767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:21 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] 7378f7a9-2187-44ac-877f-b364759c73c2 was raw, converting to raw {{(pid=92320) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 12 05:08:21 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:21 devstack sudo[112773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:21 devstack sudo[112773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-8898b709-412f-4873-9a71-2e029fd3bef1-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-8898b709-412f-4873-9a71-2e029fd3bef1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:22 devstack sudo[112767]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-8898b709-412f-4873-9a71-2e029fd3bef1" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.689s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:22 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleted volume successfully. Jun 12 05:08:22 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-8898b709-412f-4873-9a71-2e029fd3bef1" acquired by "delete_volume" :: waited 0.024s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d" returned: 0 in 0.819s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c73d139-8528-42c2-ae6e-7bee8e617472]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-9dfbb6b6-ef34-470a-a30a-a2e276b81dea tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-1293fe51-c639-4d79-b537-9f99e22e8e91-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:22 devstack sudo[112782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d Jun 12 05:08:22 devstack sudo[112782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:22 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 Jun 12 05:08:22 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:22 devstack sudo[112773]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 0 in 0.744s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7378f7a9-2187-44ac-877f-b364759c73c2_hviwnwoidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 12 05:08:22 devstack cinder-volume[92320]: INFO cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Converted 0.00 MB image at 0.00 MB/s Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 1G {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:22 devstack sudo[112786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 1G Jun 12 05:08:22 devstack sudo[112786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:22 devstack sudo[112782]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-7ea08172-3910-4e5a-927a-f2685704de8d" returned: 0 in 0.641s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-7ea08172-3910-4e5a-927a-f2685704de8d" released by "delete_volume" :: held 1.522s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:22 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Created reservations ['88eb4514-5e19-4871-91e3-e65eec8feb50', '3d60a350-17d9-41d1-bf63-795d50d15357', '6b470eef-ee86-4e06-9a0b-01c2d223641c', '7cbc4204-ebe1-4e2f-8321-43697904a274'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:23 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1" returned: 0 in 0.752s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:23 devstack sudo[112795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1 Jun 12 05:08:23 devstack sudo[112795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:23 devstack sudo[112786]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 1G" returned: 0 in 0.649s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:23 devstack sudo[112797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:23 devstack sudo[112797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[9993c786-e096-41c4-97f1-325a992cccbd]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:23 devstack sudo[112799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:23 devstack sudo[112799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-eb9f8245-c842-421f-873c-c3ccf8557eb1-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-eb9f8245-c842-421f-873c-c3ccf8557eb1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "cinder-quobyte-eb9f8245-c842-421f-873c-c3ccf8557eb1" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-eb9f8245-c842-421f-873c-c3ccf8557eb1" acquired by "delete_volume" :: waited 0.026s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:23 devstack sudo[112795]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-8898b709-412f-4873-9a71-2e029fd3bef1" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-8898b709-412f-4873-9a71-2e029fd3bef1" released by "delete_volume" :: held 1.462s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[1040a58f-8f6e-48f9-81d7-f75859d65c24]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:23 devstack sudo[112797]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.696s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:23 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Deleted volume successfully. Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-495a782f-2490-454a-8c46-e027430f5a1b tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-7ea08172-3910-4e5a-927a-f2685704de8d-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['92ece640-8b23-42dd-8958-e710b362d47c', 'd9d55da1-0942-4c8b-ab8f-9c7ad934b45e', '6d3483f8-e9fd-4411-8eaf-03c898e40dce', '132bce2d-69fe-40fb-b96c-0fe8f45a79ec'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:23 devstack sudo[112804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 Jun 12 05:08:23 devstack sudo[112804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:23 devstack sudo[112799]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 0 in 0.783s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:23 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:23 devstack sudo[112808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:23 devstack sudo[112808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:23 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:23 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-4704e5fd-c6d0-494e-8d22-3e962b5ce752-delete_snapshot" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-4704e5fd-c6d0-494e-8d22-3e962b5ce752-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-98fb035c-16e9-4d53-92a9-cc9765cceb3a" by "delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-98fb035c-16e9-4d53-92a9-cc9765cceb3a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-4704e5fd-c6d0-494e-8d22-3e962b5ce752" by "_delete_snapshot" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-4704e5fd-c6d0-494e-8d22-3e962b5ce752" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleting offline snapshot 4704e5fd-c6d0-494e-8d22-3e962b5ce752 of volume 98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] snapshot_file for this snap is: volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 {{(pid=92320) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[88476002-4a45-40a0-a7df-6ef86b0701f1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:24 devstack sudo[112808]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.613s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:24 devstack sudo[112804]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleted volume successfully. Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1" returned: 0 in 0.799s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-2cb91c06-ef73-4602-8ae1-7b1d2bc1360e tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-8898b709-412f-4873-9a71-2e029fd3bef1-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:24 devstack sudo[112817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1 Jun 12 05:08:24 devstack sudo[112817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:24 devstack sudo[112816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 Jun 12 05:08:24 devstack sudo[112816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:24 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 1 in 0.827s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Downloaded image 7378f7a9-2187-44ac-877f-b364759c73c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/7378f7a9-2187-44ac-877f-b364759c73c2', 'metadata': {}}])) to volume cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 successfully. {{(pid=92320) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.image.image_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Temporary image 7378f7a9-2187-44ac-877f-b364759c73c2 for user 40f4bd74318a48c1bcf8f6abaae06af1 is deleted. {{(pid=92320) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.volume_utils [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Marking volume cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 as bootable. {{(pid=92320) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Copying metadata from image 7378f7a9-2187-44ac-877f-b364759c73c2 to cf8b7d28-ee64-4343-9a47-00e0c6ba0c16. {{(pid=92320) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Creating volume glance metadata for volume cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 backed by image 7378f7a9-2187-44ac-877f-b364759c73c2 with: {'image_id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c044c4cf8cc4daff2969d4a83cb582d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92320) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6282e9-48a9-4eba-9a31-50dade260de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16', 'volume_size': 1, 'image_id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7378f7a9-2187-44ac-877f-b364759c73c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c044c4cf8cc4daff2969d4a83cb582d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43d39aa1cfed4e86893575d0ec41139c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98d6c9e730daf5b7430d9517df66f798fc4e8768312d9e6f92068c342bb93b6b39cbe78dccdf48cb3ad4df5395539dca4cb82c9367b5f239a9c98cb2f5feedd2', 'id': '7378f7a9-2187-44ac-877f-b364759c73c2', 'created_at': datetime.datetime(2026, 6, 12, 3, 8, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 12, 3, 8, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7378f7a9-2187-44ac-877f-b364759c73c2/file', 'properties': {}}, 'image_service': }' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925c2853-cb50-4d78-b627-570536f445e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 12 05:08:24 devstack cinder-volume[92320]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Volume volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 (cf8b7d28-ee64-4343-9a47-00e0c6ba0c16): created successfully Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925c2853-cb50-4d78-b627-570536f445e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92320) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 12 05:08:24 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Flow 'volume_create_manager' (b3971a4a-ccce-4e7c-bc36-cd57c3e7e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92320) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 12 05:08:24 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-9ecd0c5f-72ea-4d94-98d3-cdf81487d751 tempest-VolumeImageDependencyTests-339303090 None] Created volume successfully. Jun 12 05:08:25 devstack sudo[112817]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-eb9f8245-c842-421f-873c-c3ccf8557eb1" returned: 0 in 0.662s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Acquiring lock "cinder-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-quobyte-eb9f8245-c842-421f-873c-c3ccf8557eb1" released by "delete_volume" :: held 1.526s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Lock "cinder-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:25 devstack sudo[112816]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752" returned: 0 in 0.773s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.remotefs [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92320) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e175e-9d37-452a-9fdf-9ab9a4d470a1]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Acquiring lock "cinder-quobyte-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Created reservations ['2f5cdbf9-d322-4645-b955-c0b1416224b7', 'a7bb9ac7-d681-4eb2-92a8-98afd6874656', '532777dd-15bd-44cd-9ab8-17e496914b60', '03b76059-dca0-46d3-bd77-bb7353588280'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Lock "cinder-quobyte-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" acquired by "delete_volume" :: waited 0.025s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:25 devstack sudo[112827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a Jun 12 05:08:25 devstack sudo[112827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c8548-25ae-4040-9944-3cebf6e621c3]: (4, 'raw') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:25 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:25 devstack sudo[112830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:25 devstack sudo[112830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:25 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:25 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:26 devstack sudo[112827]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a" returned: 0 in 0.815s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:26 devstack sudo[112839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 Jun 12 05:08:26 devstack sudo[112839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:26 devstack sudo[112830]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.681s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:26 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Deleted volume successfully. Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-a89f2f2f-49a8-46c9-87f8-52fb575cd767 tempest-CinderUnicodeTest-1013269606 None] Lock "cinder-eb9f8245-c842-421f-873c-c3ccf8557eb1-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:26 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 0 in 0.827s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:26 devstack sudo[112842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:26 devstack sudo[112842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:26 devstack sudo[112839]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752" returned: 0 in 0.791s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:26 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752 Jun 12 05:08:26 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:26 devstack sudo[112842]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 1 in 0.749s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16' failed. Not Retrying. {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 12 05:08:26 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:26 devstack sudo[112853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16 Jun 12 05:08:26 devstack sudo[112853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:27 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a.4704e5fd-c6d0-494e-8d22-3e962b5ce752" returned: 0 in 0.640s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-4704e5fd-c6d0-494e-8d22-3e962b5ce752" released by "_delete_snapshot" :: held 3.134s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-98fb035c-16e9-4d53-92a9-cc9765cceb3a" released by "delete_snapshot" :: held 3.164s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['c9abbe84-a2dd-45fe-a906-a8c878e03a4a', '61c182c0-6499-4d0e-86bf-a5136227b244', 'd3d13fdf-7372-4162-8ba1-bb0fe97a077b', '68f1f2c5-b469-4632-a704-2bb71f8c4916'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:27 devstack sudo[112853]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" returned: 0 in 0.661s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Lock "cinder-quobyte-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16" released by "delete_volume" :: held 2.325s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:27 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Delete snapshot completed successfully. Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-b8d2bcf1-4f1b-4a7c-8e25-600bcab0e640 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-4704e5fd-c6d0-494e-8d22-3e962b5ce752-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Created reservations ['a67f5287-8b4a-4e99-bb43-6e4dc5487447', 'a2d7e1b9-f29c-4803-9342-8bc02c17a1ad', 'b7332a20-4f11-43df-8027-72961e33f504', '5a42f2ac-e619-4601-862c-c45007af2440'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:27 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:27 devstack sudo[112857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:27 devstack sudo[112857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:28 devstack sudo[112857]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.594s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:28 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Deleted volume successfully. Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-229a6e3e-bf6f-4826-b4c5-c22f86a94913 tempest-VolumeImageDependencyTests-339303090 None] Lock "cinder-cf8b7d28-ee64-4343-9a47-00e0c6ba0c16-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-98fb035c-16e9-4d53-92a9-cc9765cceb3a-delete_volume" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-98fb035c-16e9-4d53-92a9-cc9765cceb3a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "cinder-quobyte-98fb035c-16e9-4d53-92a9-cc9765cceb3a" by "delete_volume" {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-98fb035c-16e9-4d53-92a9-cc9765cceb3a" acquired by "delete_volume" :: waited 0.016s {{(pid=92320) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b13b9-5930-4a35-a343-7f8997c5356a]: (4, 'qcow2') {{(pid=93259) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 12 05:08:28 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:28 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a Jun 12 05:08:28 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:29 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a" returned: 0 in 0.738s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:29 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:29 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a Jun 12 05:08:29 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:30 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9/volume-98fb035c-16e9-4d53-92a9-cc9765cceb3a" returned: 0 in 0.637s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-quobyte-98fb035c-16e9-4d53-92a9-cc9765cceb3a" released by "delete_volume" :: held 1.434s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG cinder.quota [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Created reservations ['f4b9b6b2-f048-484b-a29b-8982a76ea47f', '6c4813ac-ac59-459b-9d52-86ae7e5cde8f', 'fb6dd4ad-65b7-4908-82a3-81e51bfca557', 'f71d8171-5700-40c4-9d94-bb1eb9e3aed4'] {{(pid=92320) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:30 devstack sudo[112871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:30 devstack sudo[112871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:30 devstack sudo[112871]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.600s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:30 devstack cinder-volume[92320]: INFO cinder.volume.manager [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Deleted volume successfully. Jun 12 05:08:30 devstack cinder-volume[92320]: DEBUG cinder.coordination [None req-c707e841-e386-4a9e-af60-01452b9082f2 tempest-CreateVolumesFromSnapshotTest-415560743 None] Lock "cinder-98fb035c-16e9-4d53-92a9-cc9765cceb3a-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=92320) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52': None} {{(pid=92320) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG cinder.volume.drivers.quobyte [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c5501daa-f652-4ded-8b90-9b5572b83f52'] {{(pid=92320) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.lockutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92320) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 12 05:08:31 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 12 05:08:31 devstack sudo[112875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9 Jun 12 05:08:31 devstack sudo[112875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 12 05:08:32 devstack sudo[112875]: pam_unix(sudo:session): session closed for user root Jun 12 05:08:32 devstack cinder-volume[92320]: DEBUG oslo_concurrency.processutils [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a476af5cbbd075592a4ed7450028df9" returned: 0 in 0.613s {{(pid=92320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 12 05:08:32 devstack cinder-volume[92320]: DEBUG cinder.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Notifying Schedulers of capabilities ... {{(pid=92320) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 12 05:08:32 devstack cinder-volume[92320]: DEBUG oslo_service.periodic_task [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] Running periodic task VolumeManager._thread_info {{(pid=92320) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 12 05:08:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread count: 28 {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jun 12 05:08:32 devstack cinder-volume[92320]: DEBUG cinder.volume.manager [None req-88df2786-7c6a-42c6-bf60-648a661c5c75 None None] thread info: [<_MainThread(MainThread, started 133527442595968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92320) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jun 12 05:08:40 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=135,cinder:DELETE=10 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 12 05:08:40 devstack cinder-volume[92320]: DEBUG dbcounter [-] [92320] Writing DB stats cinder:UPDATE=147,cinder:SELECT=107,cinder:DELETE=12,cinder:INSERT=45 {{(pid=92320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}